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,^,' Abstract 

We introduce the tree evaluation problem^ show that it is in LogDCFL (and hence 

^1 in P), and study its branching program complexity in the hope of eventually proving 

Lj. ' a superlogarithmic space lower bound. The input to the problem is a rooted, balanced 

\^ . d-ary tree of height /i, whose internal nodes are labeled with d-ary functions on [k] = 

CN \ {1, . . . , /c}, and whose leaves are labeled with elements of [k]. Each node obtains a value 

IQ ■ in [k] equal to its d-ary function applied to the values of its d children. The output is 

the value of the root. We show that the standard black pebbling algorithm applied to 

the binary tree of height h yields a deterministic fc-way branching program with 0{k^) 

states solving this problem, and we prove that this upper bound is tight for /i = 2 and 

h = 3. We introduce a simple semantic restriction called thrifty on k-way branching 

programs solving tree evaluation problems and show that the same state bound of 

C^ ' Q{k ) is tight for all /i > 2 for deterministic thrifty programs. We introduce fractional 

pebbling for trees and show that this yields nondeterministic thrifty programs with 

0^^ft,/2+i^ states solving the Boolean problem "determine whether the root has value 

1", and prove that this bound is tight for h = 2,3,4. We also prove that this same 

bound is tight for unrestricted nondeterministic k-way branching programs solving the 

Boolean problem for h = 2,3. 



* Versions of parts of this paper appeared in [BCMSWOQ) and |BCMSW.A09] 
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Figure 1: A height 3 binary tree T2 with nodes numbered heap style. 

1 Introduction 

Below is a nondecreasing sequence of standard complexity classes between AC°(6) and the 
polynomial hierarchy. 

AC°(6) C NC^ C L C NL C LogCFL C AC^ C NC^ C P C NP C PH (1) 

A problem in AC°(6) is given by a uniform family of polynomial size bounded depth circuits 
with unbounded fan-in Boolean and mod 6 gates. As far as we know an AC°(6) circuit 
cannot determine whether a majority of its input bits are ones, and yet we cannot provably 
separate AC°(6) from any of the other classes in the sequence. This embarrassing state of 
affairs motivates this paper (as well as much of the lower bound work in complexity theory). 

We propose a candidate for separating NL from LogCFL. The Tree Evaluation problem 
FTd{h, k) is defined as follows. The input to FTd{h, k) is a balanced d-ary tree of height 
h, denoted T^ (see Fig. [1]). Attached to each internal node i of the tree is some explicit 
function /j : [k^ — )■ [k] specified as k'^ integers in [k] = {1, . . . , k}. Attached to each leaf is a 
number in [k\. Each internal tree node takes a value in [k] obtained by applying its attached 
function to the values of its children. The function problem FTd{h, k) is to compute the 
value of the root, and the Boolean problem BTd{h^ k) is to determine whether this value is 
1. 

It is not hard to show that a deterministic logspace-bounded polytime auxiliary push- 
down automaton decides BT^i^h, k), where d,h and k are input parameters. This implies by 
|Sud78] that BTdih, k) belongs to the class LogDCFL of languages logspace reducible to 
a deterministic context-free language. The latter class lies between L and LogCFL, but 
its relationship with NL is unknown (see |Mah07] for a recent survey). We conjecture that 
BTd{h, k) does not lie in NL. A proof would separate NL and LogCFL, and hence (by ([1])) 
separate NC^ and NC^ 

Thus we are interested in proving superlogarithmic space upper and lower bounds (for 
fixed degree d>2) for BTd{h, k) and FTd{h, k). Notice that for each constant k = ko > 2, 
BTd{h, ko) is an easy generalization of the Boolean formula value problem for balanced 
formulas, and hence it is in NC^ and L. Thus it is important that k be an unbounded input 
parameter. 



We use branching programs (BPs) as a nonuniform model of Turing machine space: A 
lower bound of s{n) on the number of BP states implies a lower bound of G(log s(n)) on 
Turing machine space, but to prove the converse we would need to supply the machine with 
an advice string for each input length. Thus BP state lower bounds are stronger than TM 
space lower bounds, but we do not know how to take advantage of the uniformity of TMs to 
get the supposedly easier lower bounds on TM space. In this paper all of our lower bounds 
are nonuniform and all of our upper bounds are uniform. 

In the context of branching programs we think of d and h as fixed, and we are interested 
in how the number of states required grows with k. To indicate this point of view we write 
the function problem FTd{h,k) as FT^{k) and the Boolean problem BTd{h,k) as BTll{k). 
For this it turns out that k-waj BPs are a convenient model, since an input for BT^{k) or 
FTJKk) is naturally presented as a tuple of elements in [k]. Each nonfinal state in a /c-way 
BP queries a specific element of the tuple, and branches k possible ways according to the k 
possible answers. 

It is natural to assume that the inputs to Turing machines are binary strings, so 2-way 
BPs are a closer model of TM space than are fc-way BPs for A; > 2. But every 2-way BP is 
easily converted to a fc-way BP with the same number of states, and every fc-way BP can be 
converted to a 2-way BP with an increase of only a factor of k in the number of states, so 
for the purpose of separating L and P we may as well use fc-way BPs. 

Of course the number of states required by a fc-way BP to solve the Boolean problem 
BT^{k) is at most the number required to solve the function problem FT^{k). In the other 
direction it is easy to see (Lemma [3l) that FT^{k) requires at most a factor of k more states 
than BT^{k). From the point of view of separating L and P a factor of k is not important. 
Nevertheless it is interesting to compare the two numbers, and in some cases (Corollary 1251) 
we can prove tight bounds for both: For deterministic BPs solving height 3 trees they differ 
by a factor of log k rather than k. 

The best (i.e. fewest states) algorithms that we know for deterministic k-waj BPs solving 
FT^{k) come from black pebbling algorithms for trees: If p pebbles suffice to pebble the tree 
T^ then 0{k^) states suffice for a BP to solve FT^{k) (Theorem [TUl) . This upper bound on 
states is tight (up to a constant factor) for trees of height h = 2 or h = 3 (Corollary [25]) . 
and we suspect that it may be tight for trees of any height. 

There is a well-known generalization of black pebbling called black- white pebbling which 
naturally simulates nondeterministic algorithms. Indeed if p pebbles suffice to black-white 
pebble T^ then 0{k'P) states suffice for a nondeterministic BP to solve BTl}{k). However the 
best lower bound we can obtain for nondeterministic BPs solving BT2{k) (see Figured]) is 
n(n^'^), whereas it takes 3 pebbles to black-white pebble the tree T2. This led us to rethink 
the upper bound, and we discovered that there is indeed a nondeterministic BP with 0(A;^'^) 
states which solves BT2{k). The algorithm comes from a black- white pebbling of T2 using 
only 2.5 pebbles: It places a half-black pebble on node 2, a black pebble on node 3, and adds 
a half white pebble on node 2, allowing the root to be black-pebbled (see Figure [2] on page 

This led us to the idea of fractional pebbling in general, a natural generalization of black- 



white pebbling. A fractional pebble configuration on a tree assigns two nonnegative real 
numbers b{i) and w{i) totalling at most 1, to each node i in the tree, with appropriate rules 
for removing and adding pebbles. The idea is to minimize the maximum total pebble weight 
on the tree during a pebbling procedure which starts and ends with no pebbles and has a 
black pebble on the root at some point. 

It turns out that nondeterministic BPs nicely implement fractional pebbling procedures: 
If p pebbles suffice to fractionally pebble Tj* then 0{kP) states suffice for a nondeterministic 
BP to solve BT^{k). After much work we have not been able to improve upon this 0{kP) 
upper bound for any d,h>2. We prove it is optimal for trees of height 3 (Corollary [25]) . 

We can prove that for fixed degree d the number of pebbles required to pebble (in any 
sense) the tree T^ grows as 0(/i), so the p in the above best-known upper bounds of 0{kP) 
states grows as Q{h). This and the following fact motivate further study of the complexity 
oiFTllik). 



Fact 1 A lower bound ofQ{k^^'^^) for any unbounded function r{h) on the number of states 
required to solve FT^{k) implies that L ^ LogCFL (Theorem^ and Corollary\9\j. 

Proving tight bounds on the number of pebbles required to fractionally pebble a tree turns 
out to be much more difficult than for the case of whole black-white pebbling. However we 
can prove good upper and lower bounds. For binary trees of any height h we prove an upper 
bound of h/2 + 1 and a lower bound of h/2 — 1 (the upper bound is optimal for h < A). 
These bounds can be generalized to d-aiy trees (Theorem [T5|) . 

We introduce a natural semantic restriction on BPs which solve BTll{k) or FTJKk): A 
k-waj BP is thrifty if it only queries the function f{xi, . . . , Xd) associated with a node when 
(xi, . . . , Xd) are the correct values of the children of the node. 

It is not hard to see that the deterministic BP algorithms that implement black pebbling 
are thrifty. With some effort we were able to prove a converse (for binary trees): Up is the 
minimum number of pebbles required to black-pebble T2 then every deterministic thrifty 
BP solving BT2{k) (or FT2{k)) requires Q{kP) states. Thus any deterministic BP solving 
these problems with fewer states must query internal nodes fi{x,y) where {x,y) are not the 
values of the children of node i. For the decision problem BT2{k) there is indeed a nonthrifty 
deterministic BP improving on the bound by a factor of logk (Theorem 12^ (llSp ). and this 
is tight for h = 3 (Corollary |25|) . But we have not been able to improve on thrifty BPs for 
solving any function problem FT^{k). 

The nondeterministic BPs that implement fractional pebbling are indeed thrifty. However 
here the converse is far from clear: there is nothing in the definition of thrifty that hints 
at fractional pebbling. We have been able to prove that thrifty BPs cannot beat fractional 
pebbling for binary trees of height h = 4 or less, but for general trees this is open. 

It is not hard to see that for black pebbling, fractional pebbles do not help. This may 
explain why we have been able to prove tight bounds for deterministic thrifty BPs for all 
binary trees, but only for trees of height 4 or less for nondeterministic thrifty BPs. 

We pose the following as another interesting open question: 



Thrifty Hypothesis: Thrifty BPs are optimal among /c-way BPs solving FT^{k). 

Proving this for deterministic BPs would show L ^ LogDCFL, and for nondeterministic 
BPs would show NL 7^ LogCFL. Disproving this would provide interesting new space- 
efficient algorithms and might point the way to new approaches for proving lower bounds. 

The lower bounds mentioned above for unrestricted branching programs when the tree 
heights are small are obtained in two ways: First using the Neciporuk method |Nec66j . and 
second using a method that analyzes the state sequences of the BP computations. Using the 
state sequence method we have not yet beat the VL{n'^) deterministic branching program size 
barrier (neglecting log factors) inherent to the Neciporuk method for Boolean problems, but 
we can prove lower bounds for function problems which cannot be matched by the Neciporuk 
method (Theorems [271 Ell EH [32]) . For nondeterministic branching programs with states of 
unbounded outdegree, we show that both methods yield a lower bound of Vt{'n?^'^) states 
(neglecting logs) for the decision problem -BT|, and this improves on the former VL{rt'/'^) 
bound obtained for the number of edges |Pud87t IRazQlj in such BPs. 

1.1 Summary of Contributions 

• We introduce a family of computation problems FT^{k) and BT^{k), d,h > 2, which 
we propose as good candidates for separating L and NL from apparently larger com- 
plexity classes in ([1]). Our goal is to prove space lower bounds for these problems by 
proving state lower bounds for fc-way branching programs which solve them. For h = 3 
we can prove tight bounds for each d > 2 on the number of states required by k-waj 
BPs to solve them, namely (from Corollary | 



Q(^^(3/2)d-i/2^) f^^ nondeterministic BPs solving BT^{k) 
Q(k'^'^~^ / logk) for deterministic BPs solving BT^{k) 
Q{k'^'^~^) for deterministic BPs solving FTj}{k) 

We introduce a simple and natural restriction called thrifty on BPs solving FT^{k) and 
BT^{k). The best known upper bounds for deterministic BPs solving FT^{k) and for 
nondeterministic BPs solving BT^{k) are realized by thrifty BPs. Proving even much 
weaker lower bounds than these upper bounds for unrestricted BPs would separate L 
from LogCFL (see Fact [T] above). We prove that for binary trees deterministic thrifty 
BPs cannot do better than implement black pebbling (this is far from obvious). 

We formulate the Thrifty Hypothesis (see above). Either a proof or a disproof would 
have interesting consequences. 

We introduce fractional pebbling as a natural generalization of black- white pebbling 
for simulating nondeterministic space bounded computations. We prove almost tight 
lower bounds for fractionally pebbling binary trees (Theorem [T^ . The best known 
upper bounds for nondeterministic BPs solving FTJKk) come from fractional pebbling, 
and these can be implemented by thrifty BPs. An interesting open question is to 
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prove that nondeterministic thrifty BPs cannot do better than implement fractional 
pebbling. (We prove this for h = 2,3, 4.) 

• We use a "state sequence" method for proving size lower bounds for branching programs 
solving FT^{k) and BT^{k), and show that it improves on the Neciporuk method for 
certain function problems. 

The next major step is to prove good lower bounds for trees of height h = A. If we can 
prove the above Thrifty Hypothesis for deterministic BPs solving the function problem (and 
hence the decision problem) for trees of height 4, then we would beat the f2(n^) limitation 
mentioned above on Neciporuk's method. See Section [6] (Conclusion) for this argument, and 
a comment about the nondeterministic case. 

1.2 Relation to previous work 

Taitslin jTaiOS] proposed a problem similar to BT2{k) in which the functions attached to 
internal nodes are specific quasi groups, in an unsuccessful attempt to prove NL ^ P. 

Gal, Koucky and McKenzie [GKMOS] proved exponential lower bounds on the size of 
restricted n-way branching programs solving versions of the problem GEN. Like our problems 
BTll{k) and FT^{k), the best known upper bounds for solving GEN come from pebbling 
algorithms. 

As a concrete approach to separating NC from NC , Karchmer, Raz and Wigderson 
|KRW95j suggested proving that the circuit depth required to compose a Boolean function 
with itself h times grows appreciably with h. They proposed the universal composition 
relation conjecture, stating that an abstraction of the composition problem requires high 
communication complexity, as an intermediate goal to validate their approach. This con- 
jecture was later proved in two ways, first [EIRSOlj using innovative information-theoretic 
machinery and then |HW93] using a clever new complexity measure that generalizes the 
subadditivity property implicit in Neciporuk's lower bound method [Nec66j . Proving the 
conjecture thus cleared the road for the approach, yet no sufficiently strong unrestricted 
circuit lower bounds could be proved using it so far. 

Edmonds, Impagliazzo, Rudich and Sgall [EIRSOlj noted that the approach would in 
fact separate NC^ from AC^. They also coined the name Iterated Multiplexor for the most 
general computational problem considered in |KRW95J . namely composing in a tree-like 
fashion a set of explicitly presented Boolean functions, one per tree node. Our problem 
FTll{k) can be considered as a generalization of the Iterated Multiplexor problem in which 
the functions map [k^ to [k] instead of {0, l}'' to {0, 1}. This generalization allows us to 
focus on getting lower bounds as a function of k when the tree is fixed. 

For time-restricted branching programs, Borodin, Razborov and Smolensky [BRS93J ex- 
hibited a family of Boolean functions that require exponential size to be computed by nonde- 
terministic syntactic read-fc times BPs. Later Beame, Saks, Sun, and Vee JBSSV03] exhibited 
such functions that require exponential size to be computed by randomized BPs whose com- 
putation time is limited to o{n A/log n/ log log n) , where n is the input length. However all 
these functions can be computed by polynomial size BPs when time is unrestricted. 



In the present paper we consider branching programs with no time restriction such as 
read- A; times. However the smallest size deterministic BPs known to us that solve FT^{k) 
implement the black pebbling algorithm, and these BPs happen to be (syntactic) read-once. 

1.3 Organization 

The paper is organized as follows. Section [2] defines the main notions used in this paper, 
including branching programs and pebbling. Section |3] relates pebbling and branching pro- 
grams to Turing machine space, noting in particular that a fc-way BP size lower bound of 
j^^^function(ft.)^ £qj, i?TJ'(fc) would show L ^ LogCFL. Section H] proves upper and lower 
bounds on the number of pebbles required to black, black-white and fractionally pebble the 
tree T^. These pebbling bounds are exploited in Section [5] to prove upper bounds on the 
size of branching programs. BP lower bounds are obtained using the Neciporuk method in 
Subsection 15. 1[ Alternative proofs to some of these lower bounds using the "state sequence 
method" are given in Subsection 15. 2[ An example of a function problem for which the state 
sequence method beats the Neciporuk method is given in Theorems [27] and [311 Subsection 
15.31 contains bounds for thrifty branching programs. 

2 Preliminaries 

We assume some familiarity with complexity theory, such as can be found in |Gol08] . We 
write [/c] for {1, 2, . . . , /c}. For d, h > 2 we use T^ to denote the balanced d-ary tree of height 
h. 

Warning: Here the height of a tree is the number of levels in the tree, as opposed to the 
distance from root to leaf. Thus T2 has just 3 nodes. 

We number the nodes of Tjl as suggested by the heap data structure. Thus the root is node 
1, and in general the children of node i are (when d = 2) nodes 2i, 2i + 1 (see Figure [1]). 

Definition 1 (Tree evaluation problems) Given: The treeT^ with each non-leaf node i 
independently labeled with a function fi : [fc]'^ — )■ [k] and each leaf node independently labeled 
with an element from [k], where d,h,k > 2. 

Function evaluation problem FT^{k): Compute the value vi G [k] of the root 1 ofT^, where 
in general Vi = a if i is a leaf labeled a and Vi = fi{vj^, . . . ,Vj^) if the children of i are 

ji,---,jd- 

Boolean problem BTJKk): Decide whether Vi = 1. 

2.1 Branching programs 

A family of branching programs serves as a nonuniform model of of a Turing machine. For 
each input size n there is a BP B^ in the family which models the machine on inputs of size 
n. The states (or nodes) of -B„ correspond to the possible configurations of the machine for 
inputs of size n. Thus if the machine computes in space s(n) then Bn has 2*^*^**^"^^ states. 



Many variants of the branching program model have been studied (see in particular 
the survey by Razborov |Raz91j and the book by Ingo Wegener [WegOO] ). Our definition 



below is inspired by Wegener WegOO, p. 239], by the fc-way branching program of Borodin 
and Cook |BC82] and by its nondeterministic variant |BRS93t IGKM08] . We depart from 
the latter however in two ways: nondeterministic branching program labels are attached to 
states rather than edges (because we think of branching program states as Turing machine 
configurations) and cycles in branching programs are allowed (because our lower bounds 
apply to this more powerful model). 

Definition 2 (Branching programs) A nondeterministic /c-way branching program B 

computing a total function g : [/c]'" — )■ R, where R is a finite set, is a directed rooted multi- 
graph whose nodes are called states. Every edge has a label from [k] . Every state has a label 
from [m], except \R\ final sink states consecutively labelled with the elements from R. An 
input {xi, . . . ,Xm) G [k]"^ activates, for each I < j < rn, every edge labelled Xj out of every 
state labelled j . A computation on input x = (xi, . . . , Xm) G [k]"^ is a directed path consisting 
of edges activated by x which begins with the unique start state (the root), and either it is 
infinite, or it ends in the final state labelled g{xi, . . . ,Xm), or it ends in a nonfinal state 
labelled j with no outedge labelled Xj (in which case we say the computation abortsj. At least 
one such computation must end in a final state. The size of B is its number of states. B is 
deterministic A;- way if every non- final state has precisely k outedges labelled 1, . . . ,k. B is 
binary if k = 2. 

We say that B solves a decision problem (relation) if it computes the characteristic func- 
tion of the relation. 

A k-waj branching program computing the function FT^{k) requires k"^ k-arj arguments 
for each internal node i of Tj* in order to specify the function /j, together with one fc-ary 
argument for each leaf. Thus in the notation of Definition [H FT^{k): [k]^ — )■ R where 
R = [k] and m = ^^^^ ■ k'^ + d^-^. Also BT^{k): [A;]" -^ {0, 1}. 

For fixed rf, h we are interested in how the number of states required for a fc-way branch- 
ing program to compute FT^{k) and BTll{k) grows with k. We define #detFstates^(/c) 
(resp. #ndetFstates^(fc)) to be the minimum number of states required for a deterministic 
(resp. nondeterministic) /c-way branching program to solve FT^{k). Similarly we define 
#detBstates^(fc) and 7^ndetBstatesJ^'(A;) to be the number of states for solving BT^{k). 

The next lemma shows that the function problem is not much harder to solve than the 
Boolean problem. 

Lemma 3 

#detBstatesf5(A;) < #detFstatesf5(A;) < k ■ #detBstates^(A;) 
#ndetBstates^(A;) < #ndetFstates^(A;) < k ■ #ndetBstates^(fc) 

Proof: The left inequalities are obvious. For the others, we can construct a branching 
program solving the function problem from a sequence of k programs solving Boolean prob- 
lems, where the ith program determines whether the value of the root node is i. ■ 



Next we introduce thrifty programs, a restricted form of fc-way branching programs for 
solving tree evaluation problems. Thrifty programs efficiently simulate pebbling algorithms, 
and implement the best known upper bounds for 7^ndetBstates^(A;) and 7^detFstates^(/i;), and 
are within a factor of log A; of the best known upper bounds for #detBstates^(A;). In Section 
[5] we prove tight lower bounds for deterministic thrifty programs which solve BT^{k) and 
FT^{k). 

Definition 4 (Thrifty branching program) A deterministic k-way branching program 
which solves FT^{k) or BT^{k) is thrifty if during the computation on any input every 
query fi{x) to an internal node i of T^ satisfies the condition that x is the tuple of correct 
values for the children of node i. A nondeterministic such program is thrifty if for every 
input every computation which ends in a final state satisfies the above restriction on queries. 

Note that the restriction in the above definition is semantic, rather than syntactic. It 
somewhat resembles the semantic restriction used to define incremental branching programs 
in [GKMOS] . However we are able to prove strong lower bounds using our semantic restric- 
tion, but in [GKMOS] a syntactic restriction was needed to prove lower bounds. 

2.2 One function is enough 

The theorem in this section is not used in the sequel. 

It turns out that the complexities of FT^{k) and BT^{k) are not much different if we 
require all functions assigned to internal nodes to be the sameo To denote this restricted 
version of the problems we replace F by F and B by B. Thus FT^{k) is the function 
problem for T^ when all node functions are the same, and BT^{k) is the corresponding 
Boolean problem. To specify an instance of one of these new problems we need only give one 
copy of the table for the common node function /, together with the values for the leaves. 

Theorem 5 Let N = {d^ — l)/{d — 1) be the number of nodes in the tree T^. Any Nk-way 
branching program 13 solving FT^{Nk) (resp. BT^{Nk)) can be transformed to a k-way 
branching program B solving FT^{k) (resp. BTJKk)), where B has no more states than B 
and B is deterministic iff B is deterministic. Also for each d > 2 the decision problem 
BTd{h, k) is log space reducible to BTd{h, k) (where h, k are input parameters). 

Proof: Given an instance / of FT^{k) (or BT^{k)) we can find a corresponding instance 
/ of FT^{Nk) (or BTJ^Nk)) by coding the set of all functions fi associated with internal 
nodes i in J by a single function / associated with each node of I. Here we represent each 
element of [Nk] by a pair {i, x), where i G [A^] represents a node in T^ and x E [k]. We want 
to satisfy the following Claim: 

Claim: If a node i has a value x in J then node i has value {i, x) in I. 

Thus if z is a leaf node, then we define the leaf value for node i in / to be (i, x), where x 
is the value of leaf i in /. 



^We thank Yann Strozecki, who posed this question 
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We define the common internal node function / as follows. If nodes ii, . . . ,id are the 
children of node j in T^, then 

f{{ii,Xi),...,{id,Xd)) = {jJj{xi,...,Xd)) (2) 

The value of / is irrelevant (make it (1, 1)) if nodes ii, . . . , -i^ are not the children of j. 

An easy induction on the height of a node i shows that the above Claim is satisfied. 

Note that the value x of the root node 1 in J is easily determined by the value (l,x) of 
the root in I. We specify that the pair (1, 1) has value 1 in [N], so / is a YES instance of 
the decision problem BT^{k) iff J is a YES instance of BT^{Nk). 

To complete the proof of the last sentence in the theorem we note that the number of 
bits needed to specify / is Q{Nk'^\ogk)^ and the number of bits to specify I is dominated 
by the number to specify /, which is 0{{NkY\og{Nk)). Thus the transformation from / to 
/ is length-bounded by a polynomial in length of its argument, and it is not hard to see that 
it can be carried out in log space. 

Now we prove the first part of the theorem. Given an Nk-waj BP B solving I3T^{Nk) 
(resp. FT^{Nk)) we can find a corresponding k-waj BP B solving BT^{k) (resp. FT^{k)) 
as follows. 

The idea is that on input instance /, B acts like B on input /. Thus for each state q in 
B that queries a leaf node z, the corresponding state g in _B queries i, and for each possible 
answer x G [k], B has an outedge labelled x corresponding to the edge from q labelled (i, x). 
If q queries / at arguments as in ([2]) (where ii, . . . ,id are the children of node j) then q 
queries fj{xi, . . . ,Xd) and for each x E [k], q has an outedge labelled x corresponding to 
the edge from q labelled {j, x). If ii, . . . , i^ are not the children of j, then the node q is not 
necessary in _B, since the answer to the query is always the default (1, 1). 

In case B is solving the function problem FT^[Nk) then each output state labelled (1, x) 
is relabelled x m. B (recall that the root of T^ is number 1). Any output state q labelled 
(i,x) where i > 1 will never be reached in B (since the value of the root node of / always 
has the form (l,x)) so q can be deleted. For any edge in 13 leading to q the corresponding 
edge in B can lead anywhere. ■ 

One goal of this paper is to motivate trying to show BTd{h, k) ^ L. By Theorem O this 
is equivalent to showing BTd{h, k) ^ L. Further our suggested method is to try proving for 
each fixed h a lower bound of Vl^k^^'^) on the number of states required for a fc-way BP to 
solve FT^{k)^ where r{h) is any unbounded function (see Corollary [9] below). Again acording 
to Theorem [5] (since iV is a constant) technically speaking we may as well assume that all the 
node functions in the instance of FT^{k) are the same. However in practice this assumption 
is not helpful in proving a lower bound. For example Theorem [22] states that k^ states are 
required for a deterministic /c-way BP to solve FT2{k), and the proof assigns three different 
functions to the three internal nodes of the binary tree of height 3. 

2.3 Pebbling 

The pebbhng game for dags was defined by Paterson and Hewitt |PH70j and was used as 
an abstraction for deterministic Turing machine space in |Coo74j . Black- white pebbling was 
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introduced in |CS76j as an abstraction of nondeterministic Turing machine space (see |Nor09j 
for a recent survey). 

Here we define and use three versions of the pebbhng game. The first is a simple 'black 
pebbling' game: A black pebble can be placed on any leaf node, and in general if all children 
of a node i have pebbles, then one of the pebbles on the children can be slid to i (this is a 
"black sliding move')'. Any black pebble can be removed at any time. The goal is to pebble 
the root, using as few pebbles as possible. The second version is 'whole' black-white pebbling 
as defined in |CS76j with the restriction that we do not allow "white sliding moves". Thus 
if node i has a white pebble and each child of i has a pebble (either black or white) then the 
white pebble can be removed. (A white sliding move would apply if one of the children had 
no pebble, and the white pebble on i was slid to the empty child. We do not allow this.) A 
white pebble can be placed on any node at any time. The goal is to start and end with no 
pebbles, but to have a black pebble on the root at some time. 

The third is a new game called fractional pebbling, which generalizes whole black- white 
pebbling by allowing the black and white pebble value of a node to be any real number 
between and 1. However the total pebble value of each child of a node i must be 1 before 
the black value of i is increased or the white value of i is decreased. Figure [2] illustrates two 
configurations in an optimal fractional pebbling of the binary tree of height three using 2.5 
pebbles. 

Our motivation for choosing these definitions is that we want pebbling algorithms for 
trees to closely correspond to /c-way branching program algorithms for the tree evaluation 
problem. 

We start by defining fractional pebbling, and then define the other two notions as re- 
strictions on fractional pebbling. 

Definition 6 (Pebbling) A fractional pebble configuration on a rooted d-ary tree T is an 
assignment of a pair of real numbers {b{i), 10(1)) to each node i of the tree, where 

0<b{i),w{i) (3) 

b{i) + w{i) < 1 (4) 

Here b{i) and w{i) are the black pebble value and the white pebble value, respectively, of i, 
and b{i) + w{i) is the pebble value ofi. The number of pebbles in the configuration is the 
sum over all nodes i of the pebble value ofi. The legal pebble moves are as follows (always 
subject to maintaining the constraints ^, 1^): (i) For any node i, decrease h{i) arbitrarily, 
(a) For any node i, increase w{i) arbitrarily, (Hi) For every node i, if each child of i has 
pebble value 1, then decrease w{i) to 0, increase h{i) arbitrarily, and simultaneously decrease 
the black pebble values of the children ofi arbitrarily. 

A fractional pebbling ofT using p pebbles is any sequence of (fractional) pebbling moves 
on nodes of T which starts and ends with every node having pebble value 0, and at some 
point the root has black pebble value 1, and no configuration has more than p pebbles. 

A whole black-white pebbling of T is a fractional pebbling of T such that b{i) and w{i) 
take values in {0, 1} for every node i and every configuration. A black pebbling is a black- 
white pebbling in which w{i) is always 0. 
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Notice that rule (iii) does not quite treat black and white pebbles dually, since the 
pebble values of the children must each be 1 before any decrease of w{i) is allowed. A true 
dual move would allow increasing the white pebble values of the children so they all have 
pebble value 1 while simultaneously decreasing w{i). In other words, we allow black sliding 
moves, but disallow white sliding moves. The reason for this (as mentioned above) is that 
nondeterministic branching programs can simulate the former, but not the latter. 

We use #pebbles(T), #BWpebbles(T), and #FRpebbles(T) respectively to denote the 
minimum number of pebbles required to black pebble T, black-white pebble T, and fractional 
pebble T. Bounds for these values are given in Section |H For example for d = 2 we have 
#pebbles(T2'^) = h, ifB\Npebb\es{T^) = \h/2] + 1, and #FRpebbles(r2'') < h/2 + 1. In 
particular #FRpebbles(T|) = 2.5 (see Figure [2]). 

3 Connecting TMs, BPs, and Pebbling 

Let FTd{h, k) be the same as FTJKk) except now the inputs vary with both h and k, and 
we assume the input to FTd{h, k) is a binary string X which codes h and k and codes each 
node function /j for the tree T^ by a sequence of k'^ binary numbers and each leaf value by 
a binary number in [k], so X has length 

\X\ = Q{d''k'^ log k) (5) 

The output is a binary number in [k] giving the value of the root. 

The problem BTd{h, k) is the Boolean version of FTd{h, k): The input is the same, and 
the instance is true iff the value of the root is 1. 

Obviously BTa{h, k) and FTfi{h, k) can be solved in polynomial time, but we can prove 
a stronger result. 

Theorem 7 The problem BTa{h, k) is in LogDCFL, even when d is given as an input 
parameter. 

Proof: By |Sud78] if suffices to show that BTd{h, k) is solved by some deterministic 
auxiliary pushdown automaton M in log space and polynomial time. The algorithm for M 
is to use its stack to perform a depth-first search of the tree Tj*, where for each node i it 
keeps a partial list of the values of the children of i, until it obtains all d values, at which 
point it computes the value of i and pops its stack, adding that value to the list for the 
parent node. 

Note that the length n of an input instance is about d^k'^logk bits, so logra > dlog/c, so 
M has ample space on its work tape to write all d values of the children of a node i. ■ 

The best known upper bounds on branching program size for FT^{k) grow as k^^^\ The 
next result shows (Corollary [9]) that any lower bound with a nontrivial dependency on h in 
the exponent of k for deterministic (resp. nondeterministic) BP size would separate L(resp. 
NL) from LogDCFL. 
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Theorem 8 For each d > 2, if BTct{h^ k) is in L (resp. NLj then there is a constant q and 
a function fd{h) such that #detFstates^(A;) < fd{h)k'''i (resp. #ndetFstates^(A;) < fd{h)k'''^) 
for all h,k >2. 

Proof: By Lemma [3] it suffices to prove this for #detBstates^(/c) and #ndetBstates^(A;) 
instead of #detFstates^(A;) and 7^ndetFstates^(fc). In general a Turing machine which can 
enter at most C different configurations on all inputs of a given length n can be simulated 
(for inputs of length n) by a binary (and hence fc-ary) branching program with C states. 
Each Turing machine using space O(logn) has at most n'^ possible configurations on any 
input of length n > 2, for some constant c. By ([5]) the input for BTd{h, k) has length 
n = Q{d'^k'^ log k), so there are at most {d^k'^logky possible configurations for a log space 
Turing machine solving BTd{h,k), for some constant c'. So we can take fd{h) = d'^^ and 
Cd = c\d + l). ■ 

Corollary 9 Fix d > 2 and any unbounded function r{h). // #detFstates^(A;) G Vtikf'^^^) 
then BTd{h,k) ^ L. //#ndetFstates|j(A;) G f](A;''W) then BTd{h,k) i NL. 

The next result connects pebbling upper bounds with upper bounds for thrifty branching 
programs. 

Theorem 10 (i) IfT^ can he black pebbled withp pebbles, then deterministic thrifty branch- 
ing programs with O^k^) states can solve FTJlik) and BT^lik). 

(a) IfT^ can be fractionally pebbled withp pebbles then nondeterministic thrifty branching 
programs can solve BTJKk) with 0{kP) states. 

Proof: Consider the sequence Cq, Ci, . . . C,- of pebble configurations for a black pebbling 
of Tj* using p pebbles. We may as well assume that the root is pebbled in configuration C,-, 
since all pebbles could be removed in one more step at no extra cost in pebbles. We design 
a thrifty branching program B for solving FT^{k) as follows. For each pebble configuration 
C(, program B has k^ states; one state for each possible assignment of a value from [k] to 
each of the p pebbles. Hence B has 0{k^) states, since r is a constant independent of k. 
Consider an input I to FTJ^k), and let Vi be the value in [k] which I assigns to node i in T^ 
(see Definition [1]). We design B so that on / the computation of B will be a state sequence 
tto, «!,..., ar, where the state at assigns to each pebble the value Vi of the node i that it is 
on. (If a pebble is not on any node, then its value is 1.) 

For the initial pebble configuration no pebbles have been assigned to nodes, so the initial 
state of B assigns the value 1 to each pebble. In general if S is in a state a corresponding 
to configuration Ct, and the next configuration Ct+i places a pebble j on node i, then the 
state a queries the node i to determine Vi, and moves to a new state which assigns Vi to the 
pebble j and assigns 1 to any pebble which is removed from the tree. Note that if i is an 
internal node, then all children of i must be pebbled at Ct, so the state a 'knows' the values 
fjj, . . . , Vj^ of the children of i, so a queries fi{vj^, . . . , Vj^. 
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When the computation of B reaches a state a^ corresponding to Cr, then a,- determines 
the value of the root (since Cr has a pebble on the root), so B moves to a final state 
corresponding to the value of the root. 

The argument for the case of whole black- white pebbling is similar, except now the value 
for each white pebble represents a guess for the value Vi of the node it is on. If the pebbling 
algorithm places a white pebble j on a node at some step, then the corresponding state of B 
nondeterministically moves to any state in which the values of all pebbles except j are the 
same as before, but the value of j can be any value in [k]. If the pebbling algorithm removes 
a white pebble j from a node i, then the corresponding state has a guess f ,' for the value 
of i, and either z is a leaf, or all children of i must be pebbled. The corresponding state of 
B queries i to determine its true value Vi. If Vi ^ v[ then the computation aborts (i.e. all 
outedges from the state have label v[). Otherwise B assigns j the value 1 and continues. 

When B reaches a state a corresponding to a pebble configuration Cj for which the root 
has a black pebble j, then a knows whether or not the tentative value assigned to the root is 1. 
All future states remember whether the tentative value is 1. If the computation successfully 
(without aborting) reaches a state a^ corresponding to the final pebble configuration Cr, then 
B moves to the final state corresponding to output 1 or output 0, depending on whether the 
tentative root value is 1. 

Now we consider the case in which Co, . . . , Cr represents a fractional pebbling compu- 
tation. If b{i),w{i) are the black and white pebbled values of node i in configuration Ct, 
then a state a oi B corresponding to Ct will remember a fraction b{i) + w{i) of the logfc 
bits specifying the value f , of the node i, where the fraction b{i) of bits are verified, and the 
fraction w{i) of bits are conjectured. In general these numbers of bits are not integers, so 
they are rounded up to the next integer. This rounding introduces at most two extra bits for 
each node in Tj*, for a total of at most 2T extra bits, where T is the number of nodes in Tj*. 
Since the sum over all nodes of all pebble values is at most p, the total number of bits that 
need to be remembered for a given pebble configuration is at most p log k + 2T, where T is a 
constant. Associated with each step in the fractional pebbling there are 2^^°^^+^^ = 0{kP) 
states in the branching program, one for each setting of these bits. These bits can be up- 
dated for each of the three possible fractional pebbling moves (i), (ii), (iii) in Definition [6] in 
a manner similar to that for whole black-white pebbling. 

It is easy to see that in all cases the branching programs described satisfy the thrifty 
requirement that an internal node is queried only at the correct values for its children (or, 
in the black-white and fractional cases, the program aborts if an incorrect query is made 
because of an incorrect guess for the value of a white-pebbled node). ■ 

Corollary 11 #detFstates^(A;) = 0{k*^^^^^^<'^^'^) and #ndetFstates;^(A;) = 0{k*^^^^''''^^<'^^^). 
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4 Pebbling Bounds 

4.1 Previous results 

We start by summarizing what is known about whole black and black-white pebbling num- 
bers as defined at the end of Definition [6] (i.e. we allow black sliding moves but not white 
sliding moves). 

The following are minor adaptations of results and techniques that have been known 
since work of Loui, Meyer auf der Heide and Lengauer-Tarjan |Lou79t ladH79[ ILT80J in the 



late '70s. They considered pebbling games where sliding moves were either disallowed or 
permitted for both black and white pebbles, in contrast to our results below. 
We always assume h> 2 and d>2. 

Theorem 12 #pebbles(TJ^) = {d~l)h-d + 2. 

Proof: For h = 2 this gives 7^pebbles(T|) = d, which is obviously correct. In general we 
show #pebbles(T^^^) = 7^pebbles(TJ') + d — 1, from which the theorem follows. 

The following pebbling strategy gives the upper bound: Let the root be node 1 and the 
children be 2 ... d + 1. Pebble the nodes 2 . . .d + 1 in order using the optimal number of 
pebbles for TJ^~^, leaving a black pebble at each node. Note that for the black pebble game, 
the complexity of pebbling in the game where a pebble remains on the root is the same as 
for the game where the root has a black pebble on it at some point. The maximum number 
of pebbles at any point on the tree is d — I + #pebbles(TJ*^^). Now slide the black pebble 
from node 1 to the root, and then remove all pebbles. 

For the lower bound, consider the time t at which the children of the root all have black 
pebbles on them. There must be a final time t' before t at which one of the sub-trees rooted 
at 2, 3, ... (i+ 1 had T^ pebbles on it. This is because pebbling any of these subtrees requires 
at least Tj* pebbles, by definition. At time f, all the other subtrees must have at least 1 
black pebble each on them. If not, then there is a subtree T which does not, and it would 
have to be pebbled before time t, which contradicts the definition of t'. Thus at time t', 
there are at least Tjl + d — 1 pebbles on the tree. ■ 

Theorem 13 For d = 2 and d odd: 

#BWpebbles(rj^) = \{d - l)h/2] + 1 (6) 

For d even: 

#BWpebbles(rj') < \{d - l)h/2'\ + 1 (7) 

When d is odd, this number is the same as when white sliding moves are allowed. 

Proof: We divide the proof into three parts. 

Part I: 

We show (Q when d is odd. 
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For h = 2 this gives #BWpebbles(T|) = d, which is obviously correct. In general for odd 
d we show 

#BWpebbles(TJ'+^) = #BWpebbles(TJ^) + (rf - l)/2 (8) 

from which the theorem follows for this case. 

For the upper bound for the left hand side, we strengthen the induction hypothesis by 
asserting that during the pebbling there is a critical time at which the root has a black 
pebble and there are at most #BWpebbles(T^) — (rf— l)/2 pebbles on the tree (counting the 
pebble on the root). This can be made true when h = 2hy removing all the pebbles on the 
leaves after the root is pebbled. 

To pebble the tree TJ*^^, note that we are allowed {d — l)/2 extra pebbles over those 
required to pebble T^. Start by placing black pebbles on the left-most [d — l)/2 children of 
the root, and removing all other pebbles. Now go through the procedure for pebbling the 
middle principal subtree, stopping at the critical time, so that there is a black pebble on the 
middle child of the root and at most #BWpebbles(T^) — {d — l)/2 pebbles on the middle 
subtree. Now place white pebbles on the remaining {d — l)/2 children of the root, slide a 
black pebble to the root, and remove all black pebbles on the children of the root. This is 
the critical time for pebbling T^^^: note that there are at most 7^BWpebbles(TJ*) pebbles on 
the tree (we removed the black pebble on the root of the middle subtree) . 

Now remove the pebble on the root and remove all pebbles on the middle subtree by 
completing its pebbling (keeping the {d — l)/2 white pebbles on the children in place). 
Finally remove the remaining [d — l)/2 white pebbles one by one, simply by pebbling each 
subtree, and removing the white pebble at the root of the subtree instead of black-pebbling 
it. 

To prove the lower bound for the left hand side of ([H]), we strengthen the induction 
hypothesis so that now a black-white pebbling allows white sliding moves, and the root may 
be pebbled by either a black pebble or a white pebble. (Note that for the base case the tree 
T| still requires d pebbles.) Consider such a pebbhng of T^^^ which uses as few moves as 
possible. Consider a time t at which all children of the root have pebbles on them (i.e. just 
before the root is black pebbled or just after a white pebble on the root is removed). For 
each child i, let tj be a time at which the tree rooted at i has #BWpebbles(TJ*) pebbles on 
it. We may assume 

^2 < ^3 < • • • < td+1 

Let m = {d + 3)/2 be the middle child, litm < t then each of the {d— l)/2 subtrees rooted at 
i for i < m has at least one pebble on it at time t^, since otherwise the effort made to place 
7^BWpebbles(TJ^) pebbles on it earlier is wasted. Hence (E]) holds for this case. Similarly if 
tm > t then each of the (rf — l)/2 subtrees rooted at i ioi i > m has at least one pebble on it 
at time tm, since otherwise the effort to place T^ pebbles on it later is wasted, so again ([8]) 
holds. 

Part II: 

We prove ([7]) for even degree d: 

#BWpebbles(TJ') < \{d-l)h/2] + 1 
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For h = 2 the formula gives #BWpebbles(Tj) = rf, which is obviously correct. For /i = 3 
the formula gives #BWpebbles(Tj) = (3/2)(i, which can be realized by black-pebbling d/2 + 1 
of the root's children and white-pebbling the rest. In general it suffices to prove the following 
recurrence: 

#BWpebbles(TJ'+2) < #BWpebbles(TJ') + d-l (9) 

We strengthen the induction hypothesis by asserting that during the pebbling of T^ there is 
a critical time at which the root has a black pebble and there are at most 7^BWpebbles(TJ') — 
{d — 1) pebbles on the tree (counting the pebble on the root). This is easy to see when h = 2 
and h = 3. 

We prove the recurrence as follows. We want to pebble T^ '^'^ using d — I more pebbles 
than is required to pebble Tj^. Let us call the children of the root ci, . . . , q. We start by 
placing black pebbles on Ci, . . . Cd/2- We illustrate how to do this by showing how to place 
a black pebble on Cd/2 after there are black pebbles on nodes Ci, . . . c^/2-i- At this point we 
still have d/2 extra pebbles left among the original d—1. Let us assign the names c'^, . . . c^ 
to the children of q/2. Use the d/2 extra pebbles to put black pebbles on c[, . . . , c'^,^. Now 
run the procedure for pebbling the subtree rooted at c^/2+1 up to the critical time, so there 
is a black pebble on c'^/2+i- Now place white pebbles on the remaining d/2 — 1 children of 
Cd/2, slide a black pebble up to Cd/2, remove the remaining black pebbles on the children of 
Q/2, and complete the pebbling procedure for the subtree rooted at c^/2+i' ^° ^^^^ subtree 
has no pebbles. Now remove the white pebbles on the remaining d/2 — 1 children of Cd/2 
using the remaining d/2 — 1 extra pebbles. 

At this point there are black pebbles on nodes Ci, . . . , Cd/2, and no other pebbles on the 
tree. We now place a black pebble on Cd/2+1 as follows. Let us assign the names c'/, . . . c'j to 
the children of Cd/2+i- Use the remaining d/2 — 1 extra pebbles to place black pebbles on 
c'(, . . . , c'j,2_i- Now run the pebble procedure on the subtree rooted at c^',2 up to the critical 
time, so 0^/2 has a black pebble. Now place white pebbles on the remaining d/2 children of 
Cd/2+1, slide a black pebble up to Cd/2+1, remove the remaining black pebbles on the children 
of Cd/2+1, place white pebbles on the remaining d/2 — 1 children of the root, slide a black 
pebble up to the root, and remove the remaining black pebbles from the children of the root. 

This is now the critical time for the procedure pebbling TJ*"*"^. There is a black pebble on 
the root, d/2 — 1 white pebbles on the children of the root, d/2 white pebbles on the children 
of Cd/2+1, and at most #BWpebbles(T^) — d pebbles on the subtree rooted at c'L^ (we've 
removed the black pebble on c^'^)' niaking a total of at most #BWpebbles(TJ') pebbles on 
the tree. 

Now remove the black pebble from the root and complete the pebble procedure for the 
subtree rooted at 0^/2 to remove all pebbles from that subtree. There remain d/2 — 1 white 
pebbles on the children of the root and d/2 white pebbles on the children of Cd/2+1, making a 
total of d—1 white pebbles. Now remove each of the white pebbles on the children of Cd/2+1 
by pebbling each of these subtrees in turn. Finally we can remove each of the remaining 
d/2 — 1 white pebbles on the children of the root by a process similar to the one used to 
place d/2 black pebbles on the children of the root at the beginning of the procedure (we 
now in effect have one more pebble to work with). 

18 



Part III: 

Finally we give the lower bound for the case d = 2: 

#BWpebbles(r2'^) > \h/2] + 1 

Clearly 2 pebbles are required for the tree of height 2, and it is easy to show that 3 
pebbles are required for the height 3 tree. 

In general it suffices to show that the binary tree T of height h + 2 requires at least one 
more pebble than the binary tree of height h. Suppose otherwise, and consider a pebbling 
of T that uses the minimum number of pebbles required for the tree of height h, and assume 
that the pebbling is as short as possible. Let ti be a time when the root has a black pebble. 
For i = 3,4,5 there must be a time ti when all the pebbles are on the subtree rooted at 
node i. This is because node i must be pebbled at some point, and if the pebble is white 
then right after the white pebble is removed we could have placed a black pebble in its place 
(since we do not allow white sliding moves). 

Suppose that {ti, ts, ^4, ts} are ordered such that 

Then ti cannot be either tjg or ti^ since otherwise at time ti^ there are no pebbles on the 
subtree rooted at node ii and hence its earher pebbling was wasted (since the root has yet 
to be pebbled). Similarly if ti is either tj^ or ti^ then at time tjg there are no pebbles on the 
subtree rooted at i^, and since the root has already been pebbled the later pebbling of this 
subtree is wasted. ■ 



4.2 Results for fractional pebbling 

The concept of fractional pebbling is new. Determining the minimum number p of pebbles 
required to fractionally pebble T^ is important since 0{kP) is the best known upper bound 
on the number of states required by a nondeterministic BP to solve FT^{k) (see Theorem 
[TOl) . It turns out that proving fractional pebbling lower bounds is much more difficult 
than proving whole black-white pebbling lower bounds. We are able to get exact fractional 
pebbling numbers for the binary tree of height 4 and less, but the best general lower bound 
comes from a nontrivial reduction to a paper by Klawe |Kla85] which proves bounds for the 
pyramid graph. This bound is within (i/2 + 1 pebbles of optimal for degree d trees (at most 
2 pebbles from optimal for binary trees). 

Our proof of the exact value of #FRpebbles(T2^) = 3 led us to conjecture that any nonde- 
terministic BP computing BT2{k) requires Q{k^) states. In section[5]we provide evidence for 
that conjecture by proving that any nondeterministic thrifty BP requires 0{k^) states. The 
lower bound for height 3 and any degree follows from the lower bound of Q{k2'^~2) states 
for nondeterministic branching programs computing BT^{k) (Corollary [251) . 

We start by presenting a general result showing that fractional pebbling can save at most 
a factor of two over whole black- white pebbling for any DAG (directed acyclic graph). (Here 
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Figure 2: An optimal fractional pebbling sequence for the height 3 tree using 2.5 pebbles, all 
configurations included. The grey half circle means the white value of that node is .5, whereas 
unshaded area means absence of pebble value. So for example in the seventh configuration, 
node 2 has black value .5 and white value .5, node 3 has black value 1, and the remaining 
nodes all have black and white value 0. 
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the pebbling rules for a DAG are the same as for a tree, where we require that every sink 
node (i.e. every 'root') must have a whole black pebble at some point.) We will not use 
this result, but it does provide a simple proof of weaker lower bounds than those given in 
Theorem [15] below. 

Theorem 14 If a DAG D has a fractional pebbling using p pebbles, then it has a black-white 
pebbling using 2p pebbles. 

Proof: Given a sequence P of fractional pebbling moves for a DAG D in which at most p 
pebbles are used, we define a corresponding sequence P' of pebbling moves in which at most 
2p pebbles are used. The sequence P' satisfies the following invariant with respect to P. 

(<|fc) A node v has a black pebble (resp. a white pebble) on it at time t with respect to P' iff 
b{^v) > 1/2 (resp. w{v) > 1/2) at time t with respect to P. 

An important consequence of this invariant is that if at time t in P node v satisfies 
b{v) + w{v) = 1 then at time t in P' node v is pebbled. 

We describe when a pebble is placed or removed in P. At the beginning, there are no 
pebbles on any nodes. P' simulates P as follows. Assume there is a certain configuration of 
pebbles on D, placed according to P' after time t — 1; we describe how P's move at time t 
is reflected in P'. If in the current move of P, b{v) (resp. w{v)) increases to 1/2 or greater 
(resp. greater than 1/2) for some node v, then the current pebble, if any, on v, is removed 
and a black pebble (resp. a white pebble) is placed on v in P'. Note that this is always 
consistent with the pebbling rules. If in the current configuration of P' there is a black (resp. 
white) pebble on a vertex v, and in the current move of P, b{v) (resp. w{v)) falls below 1/2, 
then the pebble on v is removed. Again, this is always consistent with the pebbling rules 
for the black-white pebble game and the fractional black-white pebble game. For all other 
kinds of moves of P, the configuration in P' does not change. 

If P is a valid sequence of fractional pebbling moves, then P' is a valid sequence of 
pebbling moves. We argue that the cost of P' is at most twice the cost of P, and that if 
there is a point at which the root has black pebble value 1 with respect to P, then there is a 
point at which the root is black-pebbled in P'. These facts together establish the theorem. 

To demonstrate these facts, we simply observe that the invariant (<|fc) holds by induction 
on the time t for the simulation we defined. This implies that at any point t, the number of 
pebbles on D with respect to P' is at most the number of nodes v for which b{v) +w{v) > 1/2 
with respect to P, and is therefore at most twice the total value of pebbles with respect to 
P at time t. Hence the cost of pebbling D using P' is at most twice the cost of pebbling D 
using P. Also, if there is a time t at which the root r has black pebble value 1 with respect 
to P, then b{r) > 1/2 at time t, so there is a black pebble on r with respect to P' at time t. 
■ 

The next result presents our best-known bounds for fractionally pebbling trees T^. 
Theorem 15 

{d - l)h/2 - d/2 < #FRpebbles(rj^) < (rf - l)h/2 + 1 
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#FRpebbles(r]) = {'i/2)d-l/2 
#FRpebbles(T2^) = 3 

We divide the proof into several parts. First we prove the upper bound: 

#FRpebbles(Ti*) <{d- l)h/2 + 1 

Proof: Let A^ be the algorithm for height h > 2. It is composed of two parts, B^ and Ch- 
Bh is run on the empty tree, and finishes with a black pebble on the root and {d — l)(/i — 2) 
white half pebbles below the root (and of these {d — l){h — 3) lie below the right child of 
the root). Next, the black pebble on the root is removed. Then Ch is run on the result, and 
finishes with the empty tree. Bh and Ch both use {d — l)h/2 + 1 pebbles. 

A'l^ is the same as Ah except that it finishes with a black half pebble on the root. It 
does this in the most straight-forward way, by leaving a black half pebble after the root is 
pebbled, and so it uses {d — l)h/2 + 1.5 pebbles for all h > 3. 

i?2- Pebble the tree of height 2 using d black pebbles. 

Bh, h > 2: Run A'f^_i on node 2 using {d — l){h — l)/2 + 1.5 pebbles, and then on node 3 
(if 3 < d) using a total of {d — l){h — l)/2 + 2 pebbles (counting the half pebble on node 2), 
and so on for nodes 2, 3 ..., d. So (d-l)(/i-l)/2 + l + (rf- l)/2 = (rf-l)V2 + l pebbles are 
used when A'f^_i is run on node d. Next run Bh-i on node d+ 1, using {d — l){h — l)/2 + 1 
pebbles on the subtree rooted at (i + 1, for (d — l)h/2 + 1 pebbles in total (counting the black 
half pebbles on node 2, . . . ,d). The result is a black pebble on node d + 1, {d — l){h — 3) 
white half pebbles under d + 1, and from earlier d — 1 black half pebbles on 2, . . . ,d, for a 
total oi {d — l){h — 2) /2 + 1 pebbles. Add a white half pebble to each oi 2, . . . ,d, then slide 
the black pebble from d+1 onto the root. Remove the black half pebbles from 2, . . . ,d. Now 
there are {d — l){h — 2) white half pebbles under the root, and a black pebble on the root. 

C2: The tree of height 2 is empty, so return. 

Ch'- The tree has no black pebbles and {d — l){h — 2) white half pebbles. Note that if a 
sequence can pebble a tree with p pebbles, then essentially the same sequence can be used 
to remove a white half pebble from the root with p + .5 pebbles. Ch runs Ch-i on node d+1, 
resulting in a tree with only a half white pebble on each of 2, . . . , rf. This takes {d — l)h/2 + 1 
pebbles. Then Ah-i is run on each oi2, . . . ,d in turn, to remove the white half pebbles. The 
first such call oi Ah-i is the most expensive, using {d—l){h—l)/2+l+{d—l)/2 = {d—l)h/2+l 
pebbles. ■ 



As noted earlier, the tight lower bound for height 3 and any degree: 

#FRpebbles(r|) > 3/2d- 1/2 

follows from the asymptotically tight lower bound of r2(A;2°'~2) states for nondeterministic 
branching programs computing BT^{k) (Corollary |25|) . We do, however, have a direct proof 
of #FRpebbles(T|) > 5/2: 
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Proof: Assume to the contrary that there is a fractional pebbhng with fewer than 2.5 
pebbles. It follows that no non-leaf node i can ever have w{i) > 0.5, since the children of 
i must each have pebble value 1 in order to decrease w{i). Since there must be some time 
ti during the pebbling sequence such that both the nodes 2 and 3 (the two children of the 
root) have pebble value 1, it follows that at time ti, 6(2) > 0.5 and 6(3) > 0.5. Hence for 
i = 2,3 there is a largest tj < ti such that node i is black-pebbled at time tj and b{i) > 0.5 
during the time interval [tj,ti]. (By 'black-pebbled' we mean at time ti — 1 both children of 
i have pebble value 1, so that at time ti the value of b{i) can be increased.) 

Assume w.l.o.g. that ^2 < ^3- Then at time t^ — 1 both children of node 3 have pebble 
value 1 and 6(2) > 0.5, so the total pebble value exceeds 2.5. ■ 



Before we prove the lower bound for all heights, which we do not believe is tight, we prove 
one more tight lower bound: 

#FRpebbles(T2^) > 3 

Proof: Let Cq, Ci, . . . , Cm be the sequence of pebble configurations in a fractional pebbling 
of the binary tree of height 4. We say that Cj is the configuration at time t. Thus Cq and Cm 
have no pebbles, and there is a first time ti such that Q^+i has a black pebble on the root. 
In general we say that step t in the pebbling is the move form Ct to Ct+i- In particular, if 
an internal node i is black-pebbled at step t then both children of i have pebble value 1 in 
Ct and node i has a positive black pebble value in Ct+i- 

Note that if any configuration Ct has a whole white pebble on some internal node then 
both children must have pebble value 1 to remove that pebble, so some configuration will 
have at least pebble value 3, which is what we are to prove. Hence we may assume that no 
node in any Ct has white pebble value 1, and hence every node must be black-pebbled at 
some step. 

For each node i we associate a critical time tj such that i is black-pebbled at step tj and 
hence the children oii each have pebble value 1 in configuration Ct^. The time ti associated 
with the root (as above) is the first step at which the root is black-pebbled, and hence nodes 
2 and 3 each have pebble value 1 in Cj^ . In general if ti is the critical time for internal node 
i, and j is a child of i, then the critical time tj for j is the largest t < ti such that j is 
black-pebbled at step t. 

Sibling Assumption: We may assume w.l.o.g. (by applying an isomorphism to the tree) 
that if i and j are siblings and i < j then ti < tj. 

In general the critical times for a path from root to leaf form a descending chain. In 
particular 

t7<t3< ti 

For each i > 1 we define hi and Wi to be the black and white pebble values of node i at the 
critical time of its parent. Thus for alH > 1 

h + Wi = i (10) 
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Now let p be the inaxiinuin pebble value of any configuration Cj in the pebbling. Our task 
is to prove that p > 3 

After the critical time of an internal node i the white pebble values of its two children 
must be removed. When the first one is removed both white values are present along with 
pebble value 1 on two children, so 

W2i + W2i+1 + 2 <p 

In particular for z = 1, 3 we have 

W2 + W3 + 2 < p (11) 

W6 + W7 + 2 < p (12) 

Now we consider two cases, depending on the order of ^2 and t^. 

CASE I: i2 < h 

Then by the Sibling Assumption, at time ty (when node 7 is black-pebbled) we have 

b2 + be + 2<p (13) 

Now if we also suppose that wq is not removed until after ti (CASE lA) then when the first 
of W2 , wq is removed we have 

W2 + We + 2<p 

so adding this equation with ( TT^ and using (TTU]) we see that p > 3 as required. 

However if we suppose that Wq is removed before ti (CASE IB) (but necessarily after 
h < h) then we have 

b2 + b3 + We + 2 < p 

then we can add this to ( ITTl) to again obtain p > 3. 

CASE II: tj < t2 

Then tg < ty < ^2 < ^3 so at time t2 we have 

bQ + b7 + 2<p 
so adding this to (IT^ we again obtain p > 3. ■ 



To prove the general lower bound, we need the following lemma: 

Lemma 16 For every finite DAG there is an optimal fractional B/W pebbling in which all 
pebble values are rational numbers. (This result is robust independent of various definitions 
of pebbling; for example with or without sliding moves, and whether or not we require the 
root to end up pebbled.) 
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Proof: Consider an optimal B/W fractional pebbling algorithm. Let the variables 6„ t and 
Wy^t stand for the black and white pebble values of node v at step t of the algorithm. 

Claim: We can define a set of linear inequalities with 0-1 coefficients which suffice to 
ensure that the pebbling is legal. 

For example, all variables are non-negative, h^^t + Wh^t < 1, initially all variables are 0, 
and finally the nodes have the values that we want, node values remain the same on steps 
in which nothing is added or subtracted, and if the black value of a node is increased at a 
step then all its children must be 1 in the previous step, etc. 

Now let p be a new variable representing the maximum pebble value of the algorithm. 
We add an inequality for each step t that says the sum of all pebble values at step t is at 
most p. 

Any solution to the linear programming problem: 

Minimize p subject to all of the above inequalities 

gives an optimal pebbling algorithm for the graph. But every LP program with rational 
coefficients has a rational optimal solution (if it has any optimal solution). ■ 



Now we can prove the lower bound for all heights: 

#FRpebbles(TJ^) >{d- l)h/2 - d/2 

Proof: 

The high-level strategy for the proof is as follows. Given d and h, we transform the tree 
T^ into a DAG Gd,h such that a lower bound on ^B\Npebb\es{Gd,h) gives a lower bound 
for #FRpebbles(TJ*). To analyze ^B\Npehb\es{Gci,h), we use a result of Klawe ^Kla85j . who 
shows that for a DAG G that satisfies a certain "niceness" property, 7^BWpebbles(G) can be 
given in terms of #pebbles(G) (and the relationship is tight to within a constant less than 
one). The black pebbling cost is typically easier to analyze. In our case, Gd,h does not satisfy 
the niceness property as-is, but just by removing some edges from Gd,h, we get a new DAG 
G'^f^ which is nice. We then show how to exactly compute #pebbles(G^^) which yields a 



lower bound on ^B\Npehh\es{Gd,h), and hence on #FRpebbles(TJ^). 

We first motivate the construction Gd,h and show that the whole black-white pebbling 
number of Gd,h is related to the fractional pebbling number of T^. 

We first use Lemma [TBI to "discretize" the fractional pebble game. The following are the 
rules for the discretized game, where c is a parameter: 

• For any node v, decrease b{v) or increase w{v) by 1/c. 

• For any node v, including leaf nodes, if all the children of v have value 1, then increase 
b{v) or decrease w{v) by 1/c. 

By Lemma [161 we can assume all pebble values are rational, and if we choose c large 
enough it is not a restriction that pebble values can only be changed by 1/c. Since sliding 
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Figure 3: ^2,3 with c = 3 

moves are not allowed, the pebbling cost for this game is at most one more than the cost of 
fractional pebbling with black sliding moves. 

Now we show how to construct Gd,h (for an example, see figure [3]). We will split up each 
node of T^ into c nodes, so that the discretized game corresponds to the whole black-white 
pebble game on the new graph. Specifically, the cost of the whole black-white pebble game 
on the new graph will be exactly c times the cost of the discretized game on T^. 

In place of each node f of T^, Gd,h has c nodes w[l], . . . , f [c]; having c' of the v[i] pebbled 
simulates v having value c'/c. In place of each edge (m, v) of T^ is a copy of the complete 
bipartite graph ([/, V), where U contains nodes m[1] . . . u[c] and V contains nodes f [1] . . . f [c]. 
If u was a parent of v in the tree, then all the edges go from \^ to ?7 in the corresponding 
complete bipartite graph. Finally, a new "root" is added at height h + 1 with edges from 
each of the c nodes at height /o. So every node at height h — 1 and lower has c parents, and 
every internal node except for the root has dc children. 

To lower bound j^B\Npebb\es{Gd,h), we will use Klawe's result |Kla85] . Klawe showed 
that for "nice" graphs G, the black-white pebbling cost of G (with black and white sliding 
moves) is at least [#pebbles/2j + 1. Of course, the black-white pebbling cost without sliding 
moves is at least the cost with them. We define what it means for a graph to be nice in 
Klawe's sense. 

Definition 17 A DAG G is nice if the following conditions hold: 

1. Ifui, U2 and u are nodes of G such that ui and U2 are children of u (i.e., there are 
edges from ui and U2 to u), then the cost of black pebbling ui is equal to the cost of 
black pebbling U2 



2. If Ui and U2 are children of u, then there is no path from Ui to U2 or from U2 to u 



^The reason for this is quite technical: Klawe's definition of pebbling is slightly different from ours in 
that it requires that the root remain pebbled. Adding a new root forces there to be a time when all c of the 
height h nodes, which represent the root of T^, are pebbled. Adding one more pebble to Gd,h changes the 
relationship between the cost of pebbling T^ and the cost of pebbling Gd.h by a negligible amount. 
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Figure 4: ^2 3 with c = 3 



3. If u,ui, . . . ,Um. are nodes none of which has a path to another, then there are node- 
disjoint paths Pi, ... , Pm such that Pi is a path from a leaf (a node with in-degree 0) 
to Ui and there is no path between u and any node in Pi. 

Gd,h is not nice in Klawe's sense. We will delete some edges from Gd,h to produce a nice 
graph G'^ ^ and we will analyze #pebbles(G'^ i^). Note that a lower bound on #BWpebbles(G"^ i^) 
is also a lower bound on #BWpebbles(Grf^/i). 

The following definition will help in explaining the construction of G^^ as well as for 
specifying and proving properties of certain paths. 



Definition 18 For u e Gdh, let T,^(m) 



he the node in Tj* such that T^{u)[i] 



u for some 



< c. For v,v' G Tj}, we say v < v' if v is visited before v' in an inorder traversal ofT^. 



For u, u' G Gd,h, 
and i < j ■ 



we say u < u' ifT^{u) < Tj^iu') or if for some v G T^ 



d ' 



u 



V\l\, u 



v[j]' 



G'^ f^ is obtained from Gd,h by removing c — 1 edges from each internal node except the 
root, as follows (for an example, see figure H]). For each internal node v of T, consider the 
corresponding nodes i;[l], f [2], . . . , t>[c] of Gd,h- Remove the edges from v[i] to its z — 1 smallest 
and c — i largest children. So in the end each internal node except the root has c{d — 1) + 1 
children. 

We first analyze #pebbles(G^ ^) and then show that it is nice. We show that #pebbles(G^ f^) 
c[{d — l)(/i — 1) + 1]. Note that an upper bound of c[{d — l)(/i — 1) + 1] is attained using a 
simple recursive algorithm similar to that used for the binary tree. 

For the lower bound, consider the earliest time t when all paths from a leaf to the root 
are blocked. Figure [5] is an example of the type of pebbling configuration that we are about 
to analyze. The last pebble placed must have been placed at a leaf, since otherwise t — 1 
would be an earlier time when all paths from a leaf to the root are blocked. Let P be 



^d,h 



U 



the newly-blocked path from a leaf to the root. Consider the set S = {u E G'^ 

P and M is a child of a node in P} of size c{d — l)(/i — l) + (c— 1) = c[{d — 1) (/i — 1) + 1] — 1 

(the c — 1 is contributed by nodes at height h). We will give a set of mutually node-disjoint 
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paths {Pu}ues such that P^ is a path from a leaf to u and P^ does not intersect P. At time 
t — 1, there must be at least one pebble on each P„, since otherwise there would still be an 
open path from a leaf to the root at time t. Also counting the leaf node that is pebbled at t 
gives c[(d-l)(h-l) + 1] pebbles. 

Definition 19 The left-most (right-most) path to u is the unique path ending at u deter- 
mined by choosing the smallest (largest) child at every level. 

Definition 20 P{1) is the node of path P at height I, if it exists. 

For each u E S at height /, if u is less than (greater than) P{1) then make Pu the left-most 
(right-most) path to u. Now we need to show that the paths {Pu}ues U {P} are disjoint. 
The following fact is clear from the definition of G^/j. 

Lemma 21 For any u,u' G G'^i^, if u < u' then the smallest child of u is not a child of u' , 
and the largest child of u' is not a child of u. 

First we show that Pu and P are disjoint. The following lemma will help now and in the 
proof that G'^ i^ is nice. 

Lemma 22 For u,v E G'^ f^ with u < v, if there is no path from u to v or from v to u then 
the left-most path to u does not intersect any path to v from a leaf, and the right-most path 
to V does not intersect any path to u from a leaf. 

Proof: Suppose otherwise and let P^ be the left-most path to u, and P!^ a path to v 
that intersects P^. Since there is no path between u and f , there is a height /, one greater 
than the height where the two paths first intersect, such that P^(Z),P^(/) are defined and 
P[^{1) < Pl{l). But then from Lemma^ P^{1 - I) ^ P',{1 - 1), a contradiction. The proof 
for the second part of the lemma is similar. ■ 

That Pu and P are disjoint follows from using Lemma [22] on u and the sibling of u in P. 

Next we show that for distinct m, u' G S", Pu does not contain u' . Suppose it does. Assume 
Pu is the left-most path to u (the other case is similar). Since u ^ u', there must be a height 
/ such that Pu{l) is defined and Pu{l — 1) = u'. From the definition of S, we know P{1) is 
also a parent of u'. From the construction of Pu, since we assumed P„ is the left-most path 
to u, it must be that Pu{l) < -P(0- -l^ut then Lemma [21] tells us that u' cannot be a child of 
P{1), a contradiction. 

The proof that Pu and Pu' do not intersect is by contradiction. Assuming that there are 
u,u' E S such that Pu and Pu' intersect, there is a height /, one greater than the height 
where they first intersect, such that P„(/) 7^ Pn'(0- Note that Pu and Pu' are both left-most 
paths or both right-most paths, since otherwise in order for them to intersect they would 
need to cross P. But then from Lemma [21] P,(/ — 1) 7^ Pu'{l- — 1), a contradiction. 

This is an example of a bottleneck of the specified structure for G'^ y^ corresponding to 
the height 3 binary tree, with c = 3: 
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Figure 5: A possible black pebbling bottleneck of 6*23, with c = 3 



The last step is to prove that G'^ ^ is nice. There are three properties specified in Definition 
[T71 Property 2 is obviously satisfied. For property 1, the argument used to give the black 
pebbling lower bound of c[{d — l)(/i — 1) + 1] can be used to give a black pebbling lower 
bound of c{d — 1)(/ — 1) + 1 for any node at height / < h (the 1 is for the last node pebbled, 
and recall the root is at height /i + 1), and that bound is tight. For property 3, choose Pi 
to be the left-most (right-most) path from Ui if Ui is less than (greater than) u. Then use 
Lemma [22] on each pair of nodes in {m, mi, . . . , Um}- 

Since #pebbles(G'^^) = c[{d - l)(/i - 1) + 1], we have 

#BWpebbles(Gd,ft) > #BWpebbles(G;^_^) > c[{d - l)(/i - 1) + l]/2 

and thus that the pebbling cost for the discretized game on T^ is at least (c?— l)(/i — 1)/2 + .5, 
which implies #FRpebbles(T^'^) >{d-l){h- l)/2 - .5. ■ 



4.3 White sliding moves 

In the definition of fractional pebbling (Definition [H]) we allow black sliding moves but not 
white sliding moves. To allow white sliding moves we would add a clause 

(iv) For every internal node i, if w{i) = 1 and j is a child of i and every child of i except j 
has total pebble value 1, then decrease w{i) to and increase w{j) so that node j has total 
pebble value 1. 

We did not include this move in the original definition because a nondeterministic /c-way 
BP solving FT^{k) or BT^{k) does not naturally simulate it. The natural way to simulate 
such a move would be to verify the conjectured value of node i (conjectured when the white 
pebble was placed on i) by comparing it with fi{vj^, . . . ,VjJ, where ji, . . . ,jd are the children 
of i. But this would require the BP to remember a ((i+l)-tuple of values, whereas potentially 
only d pebbles are involved. 

White sliding moves definitely reduce the number of pebbles required to pebble some 
trees. For example the binary tree T2 can easily be pebbled with 2 pebbles using white 
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sliding moves, but requires 2.5 pebbles without (Theorem [T5|) . The next result shows that 
8/3 pebbles suffice for pebbling T^ with white sliding moves, whereas 3 pebbles are required 
without (Theorem [T^ . 

Theorem 23 The binary tree of height 4 can be pebbled with 8/3 pebbles using white sliding 
moves. 

Proof: The height 3 binary tree can be pebbled with 2 pebbles. Use that sequence on 
node 2, but leave a third black pebble on node 2. That takes 7/3 pebbles. Put black pebbles 
on nodes 12 and 13. Slide a third black pebble up to node 6. Remove the pebbles on nodes 
12 and 13. Put black pebbles on nodes 14 and 15 - this is the ffist configuration with 8/3 
pebbles. Slide the pebble on node 14 up to node 7. Remove the pebble from 15. Put 2/3 of 
a white pebble on node 6. Slide the black pebble on node 7 up to node 3. Remove a third 
black pebble from node 6. Put 2/3 of a white pebble on node 2 - the resulting configuration 
has 8/3 pebbles. Slide the black pebble on node 3 up to the root. Remove all black pebbles. 
At this point there is 2/3 of a white pebble on both node 2 and node 6. Put a black pebble 
on node 12 and a third black pebble on node 13 - another bottleneck. Slide the 2/3 white 
pebble on node 6 down to node 13. Remove the pebbles from nodes 12 and 13. Finally, use 
8/3 pebbles to remove the 2/3 white pebble from node 2. ■ 

5 Branching Program Bounds 

In this section we prove tight bounds (up to a constant factor) for the number of states 
required for both deterministic and nondeterministic fc-way branching programs to solve the 
Boolean problems BT^{k) for all trees of height 2 and 3. (The bound is obviously Q{k'^) for 
trees of height 2, because there are d-\-k'^ input variables.) For every height h > 2 we prove 
upper bounds for deterministic thrifty programs which solve FT^{k) (Theorem [Ml dH])), and 
show that these bounds are optimal for degree d = 2 even for the Boolean problem BT^{k) 
(Theorem [33]) . We prove upper bounds for nondeterministic thrifty programs solving BT^{k) 
in general, and show that these are optimal for binary trees of height 4 or less (Theorems [241 
and [37]). 

For the nondeterministic case our best BP upper bounds for every h > 2 come from 
fractional pebbling algorithms via Theorem [TDl For the deterministic case our best bounds 
for the function problem FT^{k) come from black pebbling via the same theorem, although 
we can improve on them for the Boolean problem BT2{k) by a factor of log A; (for h>3). 

Theorem 24 (BP Upper Bounds) For all h,d>2 

#detFstates^(A;) = 0{k^'^-^^^-'^+^) (14) 

#detBstates^(A;) = 0{k^'^~^'>^'-'^+y log k), for h > 3 (15) 

#ndetBstates;j(A;) = o(A;('^~^)(^/2)+i) ^^g^ 

The first and third bounds are realized by thrifty programs. 
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Proof: The first and third bounds follow from Theorem [10] (which states that pebbling 
upper bounds give rise to upper bounds for the size of thrifty BPs) and from Theorems [T^] 
and US] (which give the required pebbling upper bounds). 

To prove (IT5l) we use a branching program which implements the algorithm below. 
Here we have a parameter m, and choosing m = [log k'^'^ — log log k'^'^] suffices to show 
#detBstates^(A;) = 0(fc('^-^)(^~i)+Vlog A;"'-i), from which ([15]) follows. We estimate the 
number of states required up to a constant factor. 

1) Compute V2 (the value of node 2 in the heap ordering), using the black pebbling algorithm 
for the principal left subtree. This requires /j;('^-i)('i-2)+i states. Divide the k possible values 
for V2 into \k/m] blocks of size m. 

2) Remember the block number for V2, and compute ^3, . . . , Vd+i- This requires k/m x k'^~'^ x 

j^^d-m-2)+i ^ j^id-i){h-i)+i 1^ g^g^^gg_ 

3) Remember t>3, . . . , Vd+i and the block number for t>2. Compute /i(a, V3, . . . , Vd+i) for each 
of the m possible values a for V2 in its block number, and keep track of the set of a's for 
which /i = 1. This requires fc'^"^ x k/m x m x 2™ = k'^2'^ states. 

4) Remember just the set of possible a's (within its block) from above (there are 2*" possi- 
bilities). Compute V2 again and accept or reject depending on whether V2 is in the subset. 
This requires k^d-i){h-2)+i2m states. 

The total number of states has order the maximum of k^'^^'^)^^^'^)+'^ / m and }i{d.-i){h-2)+i2m ^ 
which is at most 

^{d-l)(/.-l)+l/(jQg^d-l _ log log ^'^-i) 

for m = log/c*^"^ — log log A;"^"^. ■ 

We combine the above upper bounds with the Neciporuk lower bounds in Subsection 15. 1[ 
Figure [6] to obtain the following. 

Corollary 25 (Tight bounds for height 3 trees) For all d> 2 

#detFstates|^(A;) = Qi^'^-^) 
#detBstates^(A;) = e{k^^-^ / \ogk) 
#ndetBstates;^(A;) = e{k^^/^^''-^/^) 

5.1 The Neciporuk method 

The Neciporuk method still yields the strongest explicit binary branching program size lower 
bounds known today, namely 0( „ " .2 ) for deterministic |Nec66j and f2(^-^) for nondeter- 
ministic (albeit for a weaker nondeterministic model in which states have bounded outdegree 
|Pud87] . see |Raz91] ). 

By applying the Neciporuk method to a fc-way branching program B computing a function 
/ : [/c]"^ — )■ R, we mean the following well known steps |Nec66] : 
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Lower bound for FT^{k) 


Lower bound for BT^{k) 
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3{d-l)2 logfc 
















Deterministic binary 
branching program 
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Nondeterministic 
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^^S^-fcf-Iyi^ 










2d-2 "- 










Nondeterministic 
binary BP 


4^-fc¥viogfc = i2(n^/Vlogn) 


4^-A;f =n(n3/V(lognf/2) 



Figure 6: Size bounds, expressed in terms of n = Q{k'''\ogk) in the binary cases, obtained 
by applying the Neciporuk method. Rectangles indicate optimality in k when h = 3 (Cor. 
2I]). Improving any entry to (](A;"'^bounded /(h)) ^^^j^ p^^^g L C P (Cor. [9]). 



1. Upper bound the number N{s, v) of (syntactically) distinct branching programs of type 
B having s non-final states, each labelled by one of v variables. 

2. Pick a partition {Vi, . . . , Vp} of [m]. 

3. For 1 < i < p, lower bound the number ry^f) of restrictions /y. : [fc]'^*' — )■ i? of / 
obtainable by fixing values of the variables in [m] \ Vi. 

4. Then size(i?) > \R\ + Xli<i<p'5i, where Si = min{ s : N{s, \Vi\) > ry.(/) }. 
Theorem 26 Applying the Neciporuk method yields Figure\^ 



Remark The r2(n^/^/(logn)^/^) binary nondeterministic BP lower bound for the BT^{k) 
problem and in particular for BT2{k) applies to the number of states when these can have ar- 
bitrary outdegree. This seems to improve on the best known former bound of Vtiji^/"^ / logn), 
slightly larger but obtained for the weaker model in which states have bounded degree, or 
equivalently, for the switching and rectifier network model in which size is defined as the 
number of edges |Pud87l IRazQl] . 



Proof: [Proof of Theorem [26] We have A^^^^ ■'(^s,f 



rfc-way / 



deterministic BPs and N' 



fc-way 



nondet 



S,f , 



<v'-{\R\ + iy 



< v'^ ■ {s + |-R|)*^ for the number of 
(^2'^yk ^Qj, nondeterministic BPs having 

7-fc-way / 



s non- final states, each labelled with one of v variables. To see A^nondetl"^; '^)-> ^^^^ ^^^^ edges 
labelled i G [k] can connect a state S to zero or one state among the final states and can 
connect S independently to any number of states among the non-final states. 

The only decision to make when applying the Neciporuk method is the choice of the 
partition of the input variables. Here every entry in Figure E] is obtained using the same 
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partition (with the proviso that a k-aij variable in the partition is replaced by log k binary 
variables when we treat 2- way branching programs). 

We will only partition the set V of fc-ary FT^{k) or BT^{k) variables that pertain to 
internal tree nodes other than the root (we will neglect the root and leaf variables). Each 
internal tree node has d — 1 siblings and each sibling involves k'^ variables. By a litter we 
will mean any set of d k-aij variables that pertain to precisely d such siblings. We obtain 
our partition by writing ^ as a union of 



d^ 



h-2 



k'^ ■ j:fz^d' = k" 

*-" d- i 

litters. (Specifically, each litter can be defined as 

{fiUl,J2, ■ ■ ■ ,jd), fi+l{jl,J2, ■ ■ -Jd), ■■■, fi+d-l{jl,J2, ■ ■ ■ ,jd)} 

for some 1 < ji,J2, ■ ■ ■ ,jd ^ k and some d siblings i,i + 1, . . . ,i + d — 1.) 

Consider such a litter L. We claim that |-R|^ distinct functions fi : [k^ — ;• R can be 
induced by setting the variables outside of L, where \R\ = k in the case of FT^{k) and 
\R\ = 2 in the case of BT^{k). Indeed, to induce any such function, fix the "descendants 
of the litter L" to make each variable in L relevant to the output; then, set the variables 
pertaining to the immediate ancestor node v of the siblings forming L to the appropriate k'^ 
values, as if those were the final output desired; finally, set all the remaining variables in a 
way such that the values in v percolate from v to the root. 

It remains to do the calculations. We illustrate two cases. Similar calculations yield the 
other entries in Figure [61 

Nondeterministic k-way branching programs computing FTJKk). Here \R\ = k. In a correct 
program, the number s of states querying one of the d litter L variables must satisfy 

k^' < N^ZZi-^^ d)<d'-{k + ly^ ■ {2'y'' < s' ■ e^^ ■ {2y^ 

since d < s (because FTll{k) depends on all its variables), and thus 

k"^ log k < s{log s + 2k log k) + s'^k. 
Suppose to the contrary that s < {k^^r yJ\ogk)/2. Then 

s(log s + 2k log k) + s^k < s{^-— log k + + 2k log k) + s^k < s{sk) + s^k < k'^ log k 



for large k and all d > 2, a contradiction. Hence s > {k^~ ^\ogk)/2. Since this holds for 
every litter, recalling step 4 in the Neciporuk method as described prior to Theorem [261 the 
total number of states in the program is at least 

, . d^~'^ — 1 ,d~l r -, , d^'"^ — 1 , 3d 1 r 

k + k""- ^_^ ■{k—^/h^)/2> ^^_^ ■k^-^^/h^. 
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Nondeterministic binary (ie 2-way) branching programs deciding BT^{k). Here \R\ = 2. 
When the program is binary, the d variables in the htter L become d log k Boolean variables. 
The number s of states querying one of these d log k variables then verifies 

2"" < NlZZtis,d\ogk) < {dlogky ■ (2 + 1)2- ■ (2^)2- < (slogA;)- ■ 2^^+^^' 

since d < s and thus 

k'^ < slogs + s log log k + As + 2s'^ < 3s^ + 5s log log k. 

It follows that s > A; 2/2. Hence the total number of states in a binary nondeterministic 
program deciding BTll{k) is at least 

where n = Q{k'^ log k) is the length of the binary encoding of BT^{k). ■ 

The next two results show limitations on the Neciporuk method that are not necessarily 
present in the state sequence method (see Theorems [31] and [32l) . 

Let Children^{k) have the same input as FT^{k) with the exception that the root func- 
tion is deleted. The output is the tuple (^2,^3, . . . ,Vd+i) of values for the children of the 
root. Children^{k) can be computed by a k-way deterministic BP with Q(^]fid-i)h-d+2^ states 
using the same black pebbling method which yields the bound flT^ in Theorem [2] 



Theorem 27 For any d,h > 2, the best k-way deterministic BP size lower bound attainable 
for Children^ik) by applying the Neciporuk method is VL{k'^'^~^). 

Proof: The function Children^{k) : [/c]™ — )■ R has m = Q(k'^). Any partition {Vi, . . . , Vp} 
of the set of fc-ary input variables thus has p = 0{k'^). Claim: for each i, the best attainable 
lower bound on the number of states querying variables from Vi is 0{k'^~^). 

Consider such a set V^, |V^| = f > 1. Here \R\ = k"^, so the number N^'^^^^{s, v) of distinct 
deterministic BPs having s non-final states querying variables from Vi satisfies 

KT^'i^^^) > 1' ■ (s + iRiy" > (1 + k'^y'' > k'^'K 

Hence the estimate used in the Neciporuk method to upper bound N^~^'^^^{s,v) will be at 
least A;'^'^'^. On the other hand, the number of functions /y. : [A;]^ — )■ -R obtained by fixing 
variables outside of Vi cannot exceed k^^'' ^ since the number of variables outside Vi is Q{k'^). 
Hence the best lower bound on the number of states querying variables from Vi obtained by 
applying the method will be no larger than the smallest s verifying k'^'' < k'^^^ for some c 
depending on d and k. This proves our claim since then this number is at most s = 0{k'^^^). 
■ 

Let SumMod^{k) have the same input as FTJKk) with the exception that the root function 
is preset to the sum modulo k. In other words the output is f 2 + f 3 + ■ ■ ■ + Vd+i mod k. 
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Theorem 28 The best k-way deterministic BP size lower bound attainable for SuniMod\{k) 
by applying the Neciporuk method is VL{k'^). 

Proof: The function SumMod2{k) : [k]"^ — > R has m = Q(k'^). Consider a set Vi in 
any partition {V^i, . . . , Vp} of the set of A;-ary input variables, \Vi\ = v. Here \R\ = k, so the 
number N^^'^'^^ls, v) of distinct deterministic BPs having s non-sink states querying variables 
from Vi satisfies 



N^r^is^v) >r-{s + |i?|)^^ > (1 + ky^ > k'\ 

If Vi contains a leaf variable, then perhaps the number of functions induced by setting 
variables complementary to Vi can reach the maximum k^ . Neciporuk would conclude that 
k states querying the variables from such a Vi are necessary. Note that there are at most 
4 sets Vi containing a leaf variable (hence a total of 4k states required to account for the 
variables in these 4 sets). Now suppose that Vi does not contain a leaf variable. Then 
setting the variables complementary to Vi can either induce a constant function (there are k 
of those), or the sum of a constant plus a variable (there are at most fc ■ |Vi| of those) or the 
sum of two of the variables (there are at most | V^ p of those) . So the maximum number of 
induced functions is | V^p = 0(A;'^). The number of states querying variables from Vi is found 
by Neciporuk to be s > A/k. In other words s = 1. So for any of the at least p — 4 sets in 
the partition not containing a leaf variable, the method gets one state. Since p — A = 0{k'^), 
the total number of states accounting for all the Vi is 0{k'^). ■ 

5.2 The state sequence method 

Here we give alternative proofs for some of the lower bounds given in Section 15. 1[ These 
proofs are more intricate than the Neciporuk proofs but they do not suffer a priori from a 
quadratic limitation. The method also yields stronger lower bounds for Children\{k) and 
SumMod\{k) (Theorems [3T] and [321) than those obtained by applying Neciporuk's method 
(Theorems [27] and [281) . 

Theorem 29 #ndetBstates2(/i;) > k"^'^ for sufficiently large k. 

Proof: Consider an input / to BT2{k). We number the nodes in T2 as in Figure [H and 
let Vj denote the value of node j under input I. We say that a state in a computation on 
input / learns Vj if that state queries //(f|j, V2j^i) (recall 2j, 2j + 1 are the children of node 

Definition [Learning Interval] Let B be a k-way nondeterministic BP that solves BT2{k). 
Let C = 7o,7i,-'' y'jT be a computation of B on input I. We say that a state 'ji in the 
computation is critical if one or more of the following holds: 

1. i = Q or i = T 

2. 7i learns V2 and there is an earlier state which learns f | with no intervening state that 
learns f|. 
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3. 'ji learns v^ and no earlier state learns v^ unless an intervening state learns v^. 

We say that a subsequence 7j,7j+i, ■ ■ ■7j is a learning interval if ji and •jj are consecutive 
critical states. The interval is type 3 if •ji learns f|, and otherwise the interval is type 2. 

Thus type 2 learning intervals begin with 70 or a state which learns V2, and never learn 
^3 until the last state, and type 3 learning intervals begin with a state which learns f| and 
never learn V2 until the last state. 

Now let B be as above, and for j G {2, 3} let Tj be the set of all states of B which query 
the input function fj. We will prove the theorem by showing that for large k 

iFsl + iFsl > k^Vk. (17) 

For r,s E [k] let F^f^ be the set of inputs I to B whose four leaves are labelled r, s, r, s 
respectively, whose middle node functions /2 and // are identically 1 except fl{r,s) = f^ 
and fl{r,s) = f|, and fiiyl^^vl) = 1 (so v{ = 1). Thus each such J is a 'YES input', and 
should be accepted by B. 

Note that each member I of Fy'Ji, is uniquely specified by a triple 

{vi, vi fi) where fM, vi) = 1 (18) 

and hence F^f^ has exactly fc^(2^ ~^) members. 

For j G {2, 3} and r,s E [k] let F^'* be the subset of F^ consisting of those states which 
query fj{r, s). Then Fj is the disjoint union of F^''^ over all pairs (r, s) in [k] x [k]. Hence to 
prove fITTI) it suffices to show 

ira'l + irjl > Vk (19) 

for large k and all r, s in [k] . We will show this by showing 

(|Fri + l)(|Fri + l)>A:/2 (20) 

for all fc > 2. (Note that given the product, the sum is minimized when the summands are 
equal.) 

For each input I in Fyf^ we associate a fixed accepting computation C(/) of B on input 
J. 

Now fix r, s G [k]. For a, 6 G [k] and / : [A;] x [k] -^ {0, 1} with /(a, 6) = 1 we use (a, b, f) 
to denote the input / in Fy'^^ it represents as in flTSj) . 

To prove (120 p . the idea is that if it is false, then as I varies through all inputs (a, 6, /) in 
Fy'^^ there are too few states learning v^ = a and v^ = bio verify that f{a,b) = 1. Specifically, 
we can find a,b,f,g such that f{a,b) = 1 and g{a,b) = 0, and by cutting and pasting the 
accepting computation C{a,b,f) with accepting computations of the form C{a,b',g) and 
C{a',b,g) we can construct an accepting computation of the 'NO input' {a,b,g). 

We may assume that the branching program B has a unique initial state 70 and a unique 
accepting state 6acc- 

For j G {2,3}, a,b e [k] and f : [k] x [k] -^ {0,1} with f{a,b) = 1 define !fj{a,b,f) to 
be the set of all state pairs (7, 6) such that there is a type j learning interval in C{a, b, f) 
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which begins with 7 and ends with S. Note that if j = 2 then 7 G (Fg'^ U {70}) and 
5 G (r^/ U {(5^cc}), and if j = 3 then 7 G T^'^ and 5 G (F^'^ U {(^^cc})- 

To complete the definition, define <fj{a, b, f) = if /(a, 6) = 0. 

For j G {2,3} and f : [k] x [k] — )■ {0, 1} we define a function (pj[f] from [/c] to sets of 
state pairs as follows: 

ip,[f]{a) = U^2(a,6,/) CS, 

be[fc] 

ae[k] 

where ^2 = (F^ U {70}) x (F^'^ U {6acc}) and ^3 = F^ x {r/ U {6acc})- 

For each / the function (pj[f] can be specified by listing a fc-tuple of subsets of Sj, 
and hence there are at most 2'^l'^^l distinct such functions as / ranges over the 2'^ Boolean 
functions on [k] x [k], and hence there are at most 2''^^^'^^^^^^^^ pairs of functions {'^2[f], fslf])- 
If we assume that (12U]) is false, we have |S'2| + l^sl < k. Hence by the pigeonhole principle 
there must exist distinct Boolean functions f,g such that f2[f] = '^2[g] and (fslf] = fslg]- 

Since / and g are distinct we may assume that there exist a, b such that /(a, 6) = 1 and 
g{a, b) = 0. Since ip2[f]{a) = (p2[g]{a), if (7, 6) are the endpoints of a type 2 learning interval 
in C{a, b, /) there exists b' such that (7, 6) are the endpoints of a type 2 learning interval 
in C{a,b',g) (and hence g{a,b') = 1). Similarly, if (7, 5) are endpoints of a type 3 learning 
interval in C{a, b, f) there exists a' such that (7, 6) are the endpoints of a type 3 learning 
interval in C{a', b, /). 

Now we can construct an accepting computation for the 'NO input' (a, b, g) from C(a, 6, /) 
by replacing each learning interval beginning with some 7 and ending with some 5 by the 
corresponding learning interval in C{a,b',g) or C{a',b,g). (The new accepting computation 
has the same sequence of critical states as C{a, b, /).) This works because a type 2 learning 
interval never queries V3 and a type 3 learning interval never queries V2- 

This completes the proof of fl20|) and the theorem. ■ 



Theorem 30 Every deterministic branching program that solves BT2{k) has at least k^/ log k 
states for sufficiently large k. 

Proof: We modify the proof of Theorem [291 Let i? be a deterministic BP which solves 
-BT|(/i;), and for j G {2,3} let Vj be the set of states in B which query /,• (as before). It 
suffices to show that for sufficiently large k 

|F2| + |F3|>A;Vlogfc. (21) 

For r,s & [k] we define the set F'''*' to be the same as F'"^^ except that we remove the 
restriction on //. Hence there are exactly k'^2^ inputs in F"^'^. 

As before, for j G {2, 3}, F^ is the disjoint union of F^''** for r,s E [k]. Thus to prove fl^T]) 
it suffices to show that for sufficiently large k and all r, s in [k] 

\V^'\ + \V^'\>k/\ogk. (22) 
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We may assume there are unique start, accepting, and rejecting states 70, Sacci ^rej- Fix 

For each root function / : [A;] x [k] -^ {0, 1} we define the functions 

^2[/]:[fc]x(r5'^U{7o}) ^ (rru{5Acc,5iii.j}) 
Uf]--[k]xVr ^ iTru{5Acc.5REj}) 

by il)2{f]{0'i 7) = 5 if (5 is the next critical state after 7 in a computation with input (a, 6, /) 
(this is independent of 6), or 5 = Srej if there is no such critical state. Similarly ^3[/](6, 5) = 
7 if 7 is the next critical state after 5 in a computation with input (a, b, /) (this is independent 
of a), or (5 = Srej if there is no such critical state. 

CLAIM: The pair of functions (V^2 [/] , "^3 [/] ) is distinct for distinct /. 

For suppose otherwise. Then there are f,g such that ip2[f] = 4'2[g] and ipslf] = i'slg] 
but f{a,b) 7^ g{o„b) for some a,b. But then the sequences of critical states in the two 
computations C{a, b, f) and C{a, b, g) must be the same, and hence the computations either 
accept both (a, 6, /) and (a, 6, g) or reject both. So the computations cannot both be correct. 

Finally we prove ( 12^ from the CLAIM. Let S2 = |r2'*| and let S3 = iFg'^l, and let 
s = S2 + S3. Then the number of distinct pairs (V'2,'^3) is at most 

(S3 + 2f^'^+^\s2 + 2)^"=' < (s + 2)^-(^+^) 

and since there are 2^ functions / we have 

2^=' < (s + 2)'^("+^) 

so taking logs, k'^ < k{s + 1) log(s + 2) so k/ log(s + 2) < s + 1, and ([22]) follows. ■ 

Recall from Theorem ITTl that applying the Neciporuk method to Children2{k) yields an 
il{k^) size lower bound and from Theorem [251 that applying it to SumMod\{k) yields r2(fc^). 
The next two results improve on these bounds using the state sequence method. The new 
lower bounds match the upper bounds given by the pebbling method used to prove (IT^ in 
Theorem ^ 



Theorem 31 Any deterministic k-way BP for Children\{k) has at least k'^/2 states. 

Proof: Let E^true be the set of all inputs / to Children\{k) such that fi = fi = +fc 
(addition mod k), and for i G {4, 5, 6, 7} // is identically except for //(f2j, 'y2j+i)- 

Let i? be a branching program as in the theorem. For each I G E^^t^ue let C{I) be the 
computation of B on input /. 

For r^s & [k] let E'^^^^g^ be the set of inputs I in E^tme such that for i G {4, 5, 6, 7}, f |j = r 
and f |j+i = s. Then for each pair r, s each input / in E'^^^^g is completely specified by the 
quadruple vi,vl,vi,v^j, so \EXue\ = ^^• 
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For r,s & [k] and i G {4, 5, 6, 7} let F^'* be the set of states of B that query /j(r, s), and 
let 

The theorem follows from the following Claim. 
CLAIM 1: IF'-'^I > k^/2 for all r, s e [k]. 

To prove CLAIM 1, suppose to the contrary for some r, s 

\r''\ < k'^/2 (24) 

We associate a pair 

with / as follows: 7-'^ is the last state in the computation C{I) that is in F*"'^ (such a state 
clearly exists), and i G {4, 5, 6, 7} is the node queried by 7-'^. (Here f/ is the value of node i). 
We also associate a second triple U{I) with each input / in E'^tme ^s follows: 

(^4, fg, f|) if 7^ queries node 4 or 5 
( f I , f 7 , f 2 ) ot herwise . 

CLAIM 2: As / ranges over E''^^^^^^ U{I) ranges over at least /c^/2 triples in [kY". 

To prove CLAIM 2, consider the the subset E' of inputs in E^tme "whose values for nodes 
4,5,6,7 have the form a, 6, a, c for arbitrary a,b,c & [k]. For each such J in E' an adversary 
trying to minimize the number of triples U{I) must choose one of the two triples (a, b, a +k c) 
or {a,c,a +k b). There are a total of k^ distinct triples of each of the two forms, and the 
adversary must choose at least half the triples from one of the two forms, so there must be 
at least k^/2 distinct triples of the form U{I). This proves CLAIM 2. 

On the other hand by fl2^ there are fewer than k^/2 possible values for T{I). Hence there 
exist inputs I,J e E^ue such that U{I) ^ U{J) but T(/) = T{J). Since U{I) ^ U{J) but 
wf = f/ (where i is the node queried by 7^ = 7"^) it follows that either t>2 7^ V2 or t>| 7^ v^, so 
/ and J give different values to the function Children2{k). But since T{I) = T{J) if follows 
that the two computations C(/) and C{J) are in the same state 7^ = ■y^ the last time any 
of the nodes {4, 5, 6, 7} is queried, and the answers vj = vf to the queries are the same, so 
both computations give identical outputs. Hence one of them is wrong. ■ 

Theorem 32 Any deterministic k-way BP for SumMod2{k) requires at least k^ states. 

Proof: We adapt the previous proof. Now E^'^ is the set of inputs / to SumMod\{k) such 
that for i G {2,3}, // is identically one except possibly for f^{r,s), and f 4 = f g = r and 
v^ = v^ = s. Note that an input to E^'"^ can be specified by the pair {v2,v^), so E'""'^ has 
exactly k"^ elements. Define 

r^'^ = F^'^ U F^'^ 
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Now we claim that an input I in i?^'* can be specified by the pair {'y^,v^), where 'j^ is the 
last state in the computation C(/) that is in T^''^, and i G {2, 3} is the node queried by ■y^ . 

The Claim holds because (7^,^/) determines the output of the computation, which in 
turn (together with f/) determines v^,, where j is the sibling of 



I. 



From the Claim it follows that |r^'*| > k for all r,s G [k], and hence there must be at 
least k^ states in total. ■ 



5.3 Thrifty lower bounds 

See Definition H] for thrifty programs. 

Theorem [33] below shows that the upper bound given in Theorem [21] (1141) is optimal 
for deterministic thrifty programs solving the function problem FTJKk) ioi d = 2 and all 
h > 2. Theorem [37] shows that the upper bound given in Theorem [24] f[T6|) is optimal for 
nondeterministic thrifty programs solving the Boolean problem BT^{k) for d = 2 and h = A 
(it is optimal for /i < 3 by Theorem | 



Theorem 33 For any h,k, every deterministic thrifty branching program solving BT2{k) 
has at least k^ states. 

Fix a deterministic thrifty BP B that solves BT2{k). Let E be the inputs to B. Let Vars 
be the set of /c-valued input variables (so \E\ = A;''^^''^!). Let Q be the states of B. If i is an 
internal node then the i variables are fi{a, b) for a, 6 e [k], and if z is a leaf node then there 
is just one i variable k. We sometimes say "/j variable" just as an in-line reminder that i is 
an internal node. Let var(g) be the input variable that q queries. Let node be the function 
that maps each variable X to the node i such that X is an i variable, and each state q to 
node(var(g)). When it is clear from the context that q is on the computation path of J, we 
just say "g queries i" instead of "g queries the thrifty i variable of /" . 

Fix an input /, and let P be its computation path. We will choose n states on P as 
critical states for /, one for each node. Note that / must visit a state that queries the root 
(i.e. queries the thrifty root variable of J), since otherwise the branching program would 
make a mistake on an input J that is identical to I except //(f|, f|) := k — //(f|, f|); hence 
J G BT2{k) iff / ^ BT2{k). So, we can choose the root critical state for / to be the last 
state on P that queries the root. The remainder of the definition relies on the following 
small lemma: 

Lemma 34 For any J and internal node i, if J visits a state q that queries i, then for each 
child j of i, there is an earlier state on the computation path of J that queries j. 

Proof: Suppose otherwise, and wlog assume the previous statement is false for j = 2i. For 
every a 7^ v^i there is an input Ja that is identical to J except f ^° = a. But the computation 
paths of J a and J are identical up to g, so J a queries a variable /j(a, b) such that b = f^f+i 
and a 7^ V2i ^ which contradicts the thrifty assumption. ■ 
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Now we can complete the definition of tlie critical states of I. For i an internal node, if 
q is the node i critical state for / then the node 2i (resp. 2i + 1) critical state for I is the 
last state on P before q that queries 2i (resp. 2i + 1). 

We say that a collection of nodes is a minimal cut of the tree if every path from root to 
leaf contains exactly one of the nodes. Now we assign a pebbling sequence to each state on 
P, such that the set of pebbled nodes in each configuration is a minimal cut of the tree or 
a subset of some minimal cut (and once it becomes a minimal cut, it remains so), and any 
two adjacent configurations are either identical, or else the later one follows from the earlier 
one by a valid pebbling move. (Here we allow the removal of the pebbles on the children of 
a node i as part of the move that places a pebble on i.) This assignment can be described 
inductively by starting with the last state on P and working backwards. Note that implicitly 
we will be using the following fact: 

Fact 2 For any input I, if j is a descendant of i then the node j critical state for I occurs 
earlier on the computation path of I than the node i critical state for /. 

The pebbling configuration for the output state has just a black pebble on the root. 
Assume we have defined the pebbling configurations for q and every state following q on 
P, and let q' be the state before q on P. If q' is not critical, then we make its pebbling 
configuration be the same as that of q. If q' is critical then it must query a node i that is 
pebbled in q. The pebbling configuration for q' is obtained from the configuration for q by 
removing the pebble from i and adding pebbles to 2i and 2i + 1 (if i is an internal node - 
otherwise you only remove the pebble from i). 

Now consider the last critical state in the computation path P^ that queries a height 2 
node (i.e. a parent of leaves). We use r^ to denote this state and call it the supercritical 
state of /. The pebbling configuration associated with r^ is called the bottleneck configu- 
ration, and its pebbled nodes are called bottleneck nodes. The two children of node(r^) 
must be bottleneck nodes, and the bottleneck nodes form a minimal cut of the tree. The 
path from the root to node(r) is the bottleneck path, and by Fact [2] it cannot contain any 
bottleneck nodes. From all this it is easy to see that there must be at least h bottleneck 
nodes. 

Here is the main property of the pebbling sequences that we need: 

Fact 3 For any input I, if non-root node i with parent j is pebbled at a state q on P^ , then 
the node j critical state q' of I occurs later on P^ , and there is no state (critical or otherwise) 
between q and q' on P^ that queries i. 

Let R be the states that are supercritical for at least one input. Let Ej. be the inputs with 
supercritical state r. Now we can state the main lemma. 

Lemma 35 For every r E R, there is an surjective function from [/j;]|Vars|-/i ^^ j^^^ 

The lemma gives us that \Er\ < A;l^3rs|-h ^^^ every r E R. Since {Ej,}reR is a partition of E, 
there must be at least \E\/k''^^'^^'^'^ = k^ sets in the partition, i.e. there must be at least k^ 
supercritical states. So the theorem follows from the lemma. 
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Proof: Fix r & R and let D := E^. Let i^c '■= node(r). Since r is thrifty for every I 

in D, there are values f^^^ and 'y2isc+i ^^'^^ ^^^^ '^2jsc ~ '^2?sc ^^"^ '^2isc+i ~ '^2isc+i ^°^ every 
J in D. The surjective function of the lemma is computed by a procedure InterAdv that 
takes as input a [fc]-string (the advice), tries to interpret it as the code of an input in D, and 
when successful outputs that input. We want to show that for every I E D we can choose 
adv^ e [k]\^^''\-^ such that lNTERADv(adv^)i = /. 

The idea is that the procedure InterAdv traces the computation path P starting from 
state r, using the advice string adv when necessary to answer queries made by each state 
q along the path. By the thrifty property, the procedure can 'learn' the values a, b of the 
children oii = node(g) (if i is an internal node) from the query fi{a, b) of q. Each such child 
that has not been queried earlier in the trace saves one advice value for the future. By Fact 
[3] the parent of each of the h bottleneck nodes will be queried before the node itself, making 
a total savings of at least h values in the advice string. After the trace is completed, the 
remaining advice values complete the specification of the input / G -Er- 
in more detail, during the execution of the procedure we maintain a current state q, a 
partial function v* from nodes to [k], and a set of nodes Ui. Once we have added a node 
to U]_, we never remove it, and once we have added v*{i) := a to the definition of v*, we 
never change v*{i). We have reached q by following a consistent partial computation path 
starting from r, meaning there is at least one input in D that visits exactly the states and 
edges that we visited between r and q. So initially q = r. Intuitively, v*{i)l = a for some 
a when we have "committed" to interpreting the advice we have read so-far as being the 
initial segment of some complete advice string adv for an input / with v{ = a. Initially v* is 
undefined everywhere. As the procedure goes on, we may often have to use an element of the 
advice in order to set a value of v*; however, by exploiting the properties of the critical state 
sequences, for each I G D, when given the complete advice adv for / there will be at least 
h nodes U[ that we "learn" without directly using the advice. Such an opportunity arises 
when we visit a state that queries some variable /j(&i, ^2) and we have not yet committed to 
a value for at least one of v*{2i) or v*{2i + 1) (if both then, we learn two nodes). When this 
happens, we add that child or children of i to Ui (the L stands for "learned"). So initially 
Ui is empty. There is a loop in the procedure InterAdv that iterates until \Ui\ = h. Note 
that the children of isc will be learned immediately. Let v*{D) be the inputs in D consistent 
with V*, i.e. / G v*{D) iS I e D and v- = v*{i) for every i G Dom(t;*). 

Following is the complete pseudocode for InterAdv. We also state the most-important 
of the invariants that are maintained. 

Procedure lNTERADV(a G [k]*)\ 

1: q := r, U\_ := 0, v* := undefined everywhere. 

2: Loop Invariant: If N elements of a have been used, then |Dom(t'*)| = N + \U{_\. 

3: while \U^\ <h do 

4: i := node(g) 

5: if i is an internal node and 2i ^ Dom(f*) or 2i + 1 ^ Dom(f*) then 

6: let 61,62 be such that var(g) = fi{bi,b2). 
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7: if 2i ^ Dom(t;*) then 

8: v*{2i) := hi and U^ := Ui + 2i. 

9: end if 

10: if 2i + l ^ Dom(i;*) and \Ui\ < h then 

11: v*{2t + 1) := 62 and Ul := Ul + {2i + 1). 

12: end if 

13: end if 

14: if i ^ Dom(f*) then 
15: let a be the next unused element of a. 

16: v*{i) := a. 

17: end if 

18: q := the state reached by taking the edge out of q labeled v*{i). 
19: end while 

20: let b be the next |Vars| — |Dom(f*)| unused elements of a. 
21: let h, . . . , J|^.(D)| be the inputs in v*{D) sorted according to some globally fixed order 

on E. 
22: if b is the t-largest string in the lexicographical ordering of [fc]l^^''=l~l'-'°'^(^*)l, and t < 
\v*{D)\, then return ItU 

If the loop finishes, then there are at most |i?|/|Dom(t>*)| = /;;|Vars|-|Dom(i)*)| jj^p^^g [y^ 
v*{D). So for each of the inputs / enumerated on line[2T|, there is a way of setting a so that 
/ will be chosen on line [221 

Recall we are trying to show that for every I in D there is a string adv G [/^jiv^''^!-'^ 
such that lNTERADv(a)J, = /. This is easy to see under the assumption that there is such 
a string that makes the loop finish while maintaining the loop invariant; since the loop 
invariant ensures we have used |Dom(f*)| — h elements of advice when we reach line [201 and 
since line[2n]is the last time when the advice is used, in all we use at most |Vars| — h elements 
of advice. To remove that assumption, first observe that for each /, we can set the advice 
to some adv so that I G g{D) is maintained when InterAdv is run on a^ . Moreover, for 
that adv , we will never use an element of advice to set the value of a bottleneck node of /, 
and I has at least h bottleneck nodes. Note, however, that this does not necessarily imply 
that U[ (the h nodes Ui we obtain when running InterAdv on adv ) is a subset of the 
bottleneck nodes of I. Finally, note that we are of course implicitly using the fact that no 
advice elements are "wasted" ; each is used to set a different node value. ■ 

Corollary 36 For any h,k, every deterministic thrifty branching program solving 5T^(A;) 
has at least Yli2<i<h ^' states. 

Proof: The previous theorem only counts states that query height 2 nodes. The same 
proof is easily adapted to show there are at least /c'^~'+2 states that query height / nodes, for 
1 = 2 h. ■ 



^See after this code for argument that \v*{D)\ < fc|Var5|-|Dom(i,-)|^ 
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Theorem 37 Every nondeterministic thrifty branching program solving BT2{k) has Q{k^) 
states. 

Proof: As in the proof of the previous theorem we restrict attention to inputs / in which 
the function /j associated with each internal node i (except i = 1) satisfies fi{x,y) = 
except possibly when x, y are the values of its children. For r,s & [k] let E^''"^ be the set of 
all such inputs / such that for all j G {4,5,6,7}, f|^- = r and ^2^+1 = s (i.e. each pair of 
sibling leaves have values r,s), and /i is identically 1 (so / is a YES instance). Thus / is 
determined by the values of its 6 middle nodes {2, 3, 4, 5, 6, 7}, so 

\E''''\ = k^ 

Let B he a nondeterministic thrifty branching program that solves T2(4, k), and let F be the 
set of states of B which query one of the nodes 4, 5, 6, 7. We will show |F| = Q{k^). 

For r,s E [k] let F**'* be the set of states of F that query fj{r, s) for some j G {4, 5, 6, 7}. 
We will show 

|F"'^| + 1 > k/V3 (25) 

Since F is the disjoint union of F''''' for all r,s E [k], it will follow that |F| = Q{k^) as required. 

For each / G E^'^ let C{I) be an accepting computation of B on input /. Let t{ be the 
first time during C{I) that the root /i is queried. Let 'y^ be be the last state in F''''' before 
t{ in C{I) (or the initial state 70 if there is no such state) and let S^ be the first state in F^''^ 
after t{ (or the ACCEPT state Sacc if there is no such state). 

We associate with each / G i?'"'* a tuple 

[/(/) = (m,7-^,(5^,Xi,X2,X3,X4) 

where u G {1, 2, 3} is a tag, and a;i, X2, 0:3, X4 are in [k] and are chosen so that U{I) uniquely 
determines / (by determining the values of all 6 middle nodes). Specifically, Xi = f/, where 
i is the node queried by 7^ (or i = 4 if 7-^ = 70). 

We partition i?*"'* into three sets -E['*, E2^, i^g'* according to which of the nodes f 2, fa the 
computation C{I) queries during the segment of the computation between j^ and 6^ . (The 
tag u tells us that / lies in set E^''^.) 

Let node j G {2, 3} be the parent of node i (where i is defined above) and let / G {2, 3} 
be the sibling of j. 

• Ei^ consists of those inputs / for which C{I) queries neither V2 nor v^. 

• i?2'* consists of those inputs / for which C{I) queries Vj/. 

• El'^ consists of those inputs / for which C{I) queries Vj but not Vj'. 

To complete the definition of U{I) we need only specify the meaning of X2,X3,X4. 

Let S{I) denote the segment of the computation C{I) between 7^ and 6^ (not counting 
the action of the last state 6^). This segment always queries the root fi{v2,v^), but does not 
query any of the nodes 4, 5, 6, 7 except 7^ may query node i. 
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The idea is that the segment S{I) will determine (using the definition of thrifty) the 
values of (at least) two of the six middle nodes, and xi,X2,X3,X4 will specify the remaining 
four values. We require that xi,X2,X3,Xi must specify the value of any node (except the 
root) that is queried during the segment, but the state that queries the node determines the 
values of its children. 

In case the tag u = 1, the computation queries /i(f2, fs), and hence determines V2, fs, so 
Xi, a;2, X3, X4 specify the four values v^, v^, Vq, Vj. 

In case u = 2, the computation queries fji at the values of its children, so xi,X2,X3,X4 
do not specify the values of these children, but instead specify ^2,^3- 

In case u = 3, xi,X2,xs,X4 do not specify the value of the sibling of node i and do not 
specify Vji, but do specify Vj and the values of the other level 2 nodes. 

Claim: If /, J G E''' and U{I) = U{J), then I = J. 

Inequality fl2S]) (and hence the theorem) follows from the Claim, because if |r'''^| + 1 < 
fc/vS then there would be fewer than k^ choices for U{I) as / ranges over the k^ inputs in 

To prove the Claim, suppose U{I) = U{J) but I ^ J. Then we can define an accepting 
computation of input / which violates the definition of thrifty. Namely follow the computa- 
tion C{I) up to 7^. Now follow the segment of C( J) between 7^ and 5^, and complete the 
computation by following C{I). Notice that the segment of C(J) never queries any of the 
nodes 4, 5, 6, 7 except for f j, and U{I) = U{J) (together with the definition of E'^''^) specifies 
the values of the other nodes that it queries. However, since I ^ J, this segment of C{J) 
with input I will violate the definition of thrifty while querying at least one of the three 
nodes vi,V2,V3. ■ 

6 Conclusion 

The Thrifty Hypothesis (page [6]) states that thrifty branching programs are optimal among 
fc-way BPs solving FT^{k). For the deterministic case, this says that the black pebbling 
method is optimal. Proving this would separate L from P (Corollary [9]). Even disproving 
this would be interesting, since it would show that one can improve upon this obvious 
application of pebbling. 

The next important step is to extend the tight branching program bounds given in 
Corollary [25] for height 3 trees to height 4 trees. The upper bound given in Theorem [Ml 
f[T4|) for the height 4 function problem FT^{k) for deterministic BPs is 0{k^'^~'^). If we could 
match this with a similar lower bound when d = A (e.g. by using a variation of the state 
sequence method in Section [F^ this would yield fl{k^^) states for the function problem and 
hence (by Lemma [3]) fi(fc^) states for the Boolean problem BT^{k). This would break the 
Neciporuk fi(n^) barrier for branching programs (see Section [5?T]) . 

For nondeterministic BPs, the upper bound given by Theorem [24] for the Boolean problem 
for height 4 trees is 0(fc^'^~^). This comes from the upper bound on fractional pebbling given 
in Theorem [151 which we suspect is optimal for h = A and degree d = 3. The corresponding 
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lower bound for nondeterministic BPs for BT^{k) would be VL{k^). A proof would break the 
Neciporuk Vt{p?/'^) barrier for nondeterministic BPs. 

Other (perhaps more accessible) open problems are to generalize Theorem [27] to get gen- 
eral lower bounds for nondeterministic thrifty BPs solving BT2{k), and to improve Theorem 
[TSlto get tight bounds on the number of pebbles required to fractionally pebble T^. 

The proof of Theorem [331 which states that deterministic thrifty BPs require at least 
k^ states to solve BT2{k), is taken from [WehrlOJ . That paper also proves the same lower 
bound for the more general class of 'less-thrifty' BPs, which are allowed to query fi(a,b) 
provided that either (a, b) correctly specify the values of both children of i, or neither a nor 
b is correct. 

[WehrlOj also calculates {k + 1)'^ as the exact number of states required to solve FT2{k) 
using the black pebbling method, and proves this is optimal when h = 2. So far we have not 
been able to beat this BP upper bound by even one state, for any h and any k using any 
method. That this bound might actually be unbeatable (at least for all h and all sufficiently 
large k) makes an intriguing hypothesis. 

Acknowledgment James Cook played a helpful role in the early parts of this research. 

References 

[adH79] F. Meyer auf der Heide. A comparison between two variations of a pebble game 
on graphs. Master's thesis, Universitat Bielefeld, Fakultat fiir Mathematik, 1979. 

[BSSV03] P. Beame, M. Saks, X. Sun, E. Vee. Time-space tradeoff lower bounds for ran- 
domized computation of decision problems. JACM, 50(2):154-195, 2003. 

[BC82] A. Borodin and S. Cook. A time-space tradeoff for sorting on a general sequential 
model of computation. SIAM J. Comput, ll(2):287-297, 1982. 

[BRS93] A. Borodin, A. Razborov, and R. Smolensky. On lower bounds for read-k-times 
branching programs. Computational Complexity, 3:1-18, 1993. 

[BCMSW09] M. Braverman, S. Cook, P. McKenzie, R. Santhanam, D. Wehr. Branching 
programs for tree evaluation. In 34th International Symposium, Mathematical 
Foundations of Computer Science (MFCS 2009), LNCS 5734, Springer, 175-186, 
2009. 

[BCMSW.A09] M. Braverman, S. Cook, P. McKenzie, R. Santhanam, D. Wehr. Fractional 
pebbling and thrifty brancing programs. In Foundations of Software Technology 
and Theoretical Computer Science (FSTTCS 2009), LIPIcs, pp. 109-120, 2009. 

[Coo74] S. Cook. An observation on time-storage trade off. J. Comput. Syst. Sci., 9(3):308- 
316, 1974. 



46 



[CS76] S. Cook and R. Sethi. Storage requirements for deterministic polynomial time 
recognizable languages. J. Comput. Syst. Sci., 13(l):25-37, 1976. 

[EIRSOl] J. Edmonds, R. Impagliazzo, S. Rudicli, and J. Sgall. Communication complexity 
towards lower bounds on circuit depth. Computational Complexity, 10(3):210-246, 
2001. An abstract appeared in the 32nd IEEE FOCS (1991). 

[GKM08] A. Gal, M. Koucky, and P. McKenzie. Incremental branching programs. Theory 
Comput. Syst, 43(2):159-184, 2008. 

[G0IO8] O. Goldreich. Computational Complexity: A Conceptual Perspective. Cambridge 
University Press, 2008. 

[HW93] J. Hastad and A. Wigderson. Composition of the universal relation. Advances in 
Computational Complexity Theory, AMS-DIMACS, 13:119-134, 1993. 

[Kla85] M. Klawe. A tight bound for black and white pebbles on the pyramid. J. ACM, 
32(l):218-228, 1985. 

[KRW95] M. Karchmer, R. Raz, and A. Wigderson. Super-logarithmic depth lower bounds 
via direct sum in communication complexity. Computational Complexity, 5:191- 
204, 1995. An abstract appeared in the 6th Structure in Complexity Theory Con- 
ference (1991). 

[Lou79] M.C. Loui. The space complexity of two pebble games on trees. Technical Report 
LCS 133, MIT, Cambridge, Massachussetts, 1979. 

[LT80] T. Lengauer and R. Tarjan. The space complexity of pebble games on trees. Inf. 
Process. Lett, 10(4/5): 184-188, 1980. 

[Mah07] M. Mahajan. Polynomial size log depth circuits: between NC^and AC^. Bulletin 
of the EATCS, 91:30-42, February 2007. 

[Nec66] E. Neciporuk. On a boolean function. Doklady of the Academy of the USSR, 
169(4) :765-766, 1966. English translation in Soviet Mathematics Doklady 7:4, pp. 
999-1000. 

[Nor09] J. Nordstrom. New wine into old wineskins: A survey of some 

pebbling classics with supplemental results. Available on line at 

http : //people . csail . mit . edu/ j akobn/research/, 2009. 

[PH70] M. Paterson and C. Hewitt. Comparative schematology. In Record of Project 
MAC Conference on Concurrent Systems and Parallel Computations, pages 119- 
128, 1970. (June 1970) ACM. New Jersey. 

[Pud87] P. Pudlak. The hierarchy of boolean circuits. Computers and artificial intelligence, 
6(5):449-468, 1987. 

47 



[Raz91] A. Razborov. Lower bounds for deterministic and nondeterministic branching 
programs. In 8th Internal. Symp. on Fundamentals of Computation Theory, pages 
47-60, 1991. 

[Sud78] H. Sudborough. On the tape complexity of deterministic context-free languages. 
J. ACM, 25(3):405-414, 1978. 

[Tai05] M.A. Taitslin. An example of a problem from PTIME and not in NLogSpace. In 
Proceedings of Tver State University, volume 6(12) of Applied Mathematics, issue 
2, Tver State University, Tver, pages 5-22, 2005. 

[WegOO] I. Wegener. Branching Programs and Binary Decision Diagrams. SIAM Mono- 
graphs on Discrete Mathematics and Applications. Soc. for Industrial and Applied 
Mathematics, Philadelphia, 2000. 

[WehrlO] D. Wehr. Pebbling and branching programs solving the tree evaluation problem. 
MSc research paper. Department of Computer Science, University of Toronto, Feb. 
2010. arXiv: 1002.4676. 



48 



